00000001:02000400:3.0F:1787733732.470202:0:2967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787733747.743019:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787733749.219462:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 747 MB/s 00000001:01000000:2.0F:1787733749.469680:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1003 MB/s 00000001:01000000:2.0:1787733749.719253:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6055 MB/s 00000020:02000000:0.0F:1787733750.338665:0:3279:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g6de652b 00000400:02000000:2.0:1787733751.026361:0:3294:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.134@tcp [8/256/0/180] 00008000:02000000:0.0:1787733754.452965:0:3444:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787733795.239790:0:5245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787733806.288759:0:5813:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787733806.288764:0:5813:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787733806.289203:0:5813:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008b12b190 00000080:02000400:0.0:1787733806.289218:0:5813:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787733806.302483:0:5813:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787733806.302500:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787733806.302556:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008a1f5437) 00000020:00000080:0.0:1787733806.302580:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787733806.420394:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787733806.420801:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787733806.487916:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787733806.487960:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787733806.487984:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787733806.488038:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787733806.488065:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787733806.488639:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787733806.488708:0:5813:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787733806.488721:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d526f 00000020:01000004:2.0:1787733806.488730:0:5813:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787733806.488735:0:5813:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787733806.488740:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008b12b190 from MGS 00000020:01000004:2.0:1787733806.488745:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787733806.488763:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000007d43e44) 00000020:00000080:2.0:1787733806.488775:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787733806.488885:0:5813:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008b12b190 from MGS, refs=2 00080000:01000000:2.0:1787733806.488891:0:5813:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787733806.488897:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d527d 00000100:00100000:2.0:1787733806.488994:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787733806.489124:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787733806.489130:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787733806.496973:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787733806.496992:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787733806.503074:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787733806.503322:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787733806.503340:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787733806.504314:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787733806.504322:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787733806.505915:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787733806.505926:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787733806.507817:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733806.507822:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733806.507824:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733806.508138:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733806.508141:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733806.508142:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733806.508927:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787733806.518357:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787733806.758478:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1411 MB/s 00000001:01000000:2.0:1787733807.008362:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1531 MB/s 00000001:01000000:1.0:1787733807.258822:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 451 MB/s 00000001:01000000:2.0:1787733807.509219:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1159 MB/s 00080000:10000000:2.0:1787733807.531242:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1787733807.566770:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787733807.573484:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787733807.573518:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787733807.573522:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787733807.585995:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787733807.586080:0:5813:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787733807.586183:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787733807.586465:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787733807.586491:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787733807.586945:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787733807.587116:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787733807.587122:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787733807.590105:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787733807.590118:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787733807.590990:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787733807.590999:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1787733807.591820:0:5828:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787733807.591927:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787733807.591951:0:5813:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.134@tcp' 00000020:01000004:0.0:1787733807.591954:0:5813:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787733807.592003:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.134@tcp (typ=mgc) 00000020:00000080:0.0:1787733807.592015:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.134@tcp (000000008890685f) 00000020:00000080:0.0:1787733807.592032:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787733807.592124:0:5813:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000055828140@MGC192.168.201.134@tcp: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1787733807.593122:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.134@tcp-0 is initialized 00000040:01000000:0.0:1787733807.593131:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787733807.595620:0:5829:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787733807.595671:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.134@tcp (uuid df19622b-ae94-4c8d-b052-574898624480) 00000020:00000080:1.0:1787733807.595695:0:5813:0:(genops.c:1385:class_connect()) connect: client df19622b-ae94-4c8d-b052-574898624480, cookie 0x45228d86de4d528b 00000100:00080000:1.0:1787733807.595708:0:5813:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787733807.595839:0:5813:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import 0000000055828140 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787733807.595887:0:5813:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000265e8960 x1874574705688704/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787733807.595912:0:5813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import df19622b-ae94-4c8d-b052-574898624480->MGS 00000020:01000004:1.0:1787733807.595931:0:5813:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787733807.595937:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787733807.595957:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a83ff082) 00000020:00000080:1.0:1787733807.595972:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787733807.606855:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000265e8960 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df19622b-ae94-4c8d-b052-574898624480:3309:1874574705688704:0@lo:250: 00000100:00100000:3.0:1787733807.606960:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733807.607111:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705688704 00000100:00100000:0.0:1787733807.607122:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705688704 00000100:00100000:0.0:1787733807.607186:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787733807.607192:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000252e9c02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874574705688704:12345-0@lo:250: 00010000:00080000:0.0:1787733807.607221:0:5825:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from df19622b-ae94-4c8d-b052-574898624480@0@lo t0 exp 0000000000000000 cur 125 last 0 00000020:00000080:0.0:1787733807.607250:0:5825:0:(genops.c:1385:class_connect()) connect: client df19622b-ae94-4c8d-b052-574898624480, cookie 0x45228d86de4d5299 00000100:00080000:0.0:1787733807.607557:0:5825:0:(import.c:65:import_set_state_nolock()) 00000000c1f3b22b : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787733807.607630:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000252e9c02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+5:3309:x1874574705688704:12345-0@lo:250: Request processed in 436us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733807.607646:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787733807.611691:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787733807.611711:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.134@tcp: connect to target with instance 0 00000100:00080000:3.0:1787733807.611883:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787733807.611889:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787733807.611893:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000055828140 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787733807.611897:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787733807.611909:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787733807.611926:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000265e8960 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df19622b-ae94-4c8d-b052-574898624480:3309:1874574705688704:0@lo:250: 00000100:00100000:0.0:1787733807.694041:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787733807.694308:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787733807.694315:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787733807.698048:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787733807.698066:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787733807.699696:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787733807.699722:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787733807.701050:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787733807.701286:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787733807.701292:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787733807.702295:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787733807.702316:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787733807.815619:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787733807.816013:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787733807.816020:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787733807.818113:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787733807.818128:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787733807.819086:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787733807.819444:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787733807.819450:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787733807.820532:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787733807.820541:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787733807.821533:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787733807.822287:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787733807.822294:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787733807.823069:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787733807.823077:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787733807.823744:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787733807.823894:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787733807.823898:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787733807.825019:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787733807.825028:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787733807.855513:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787733807.855842:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787733807.855849:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787733807.858060:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787733807.858076:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787733807.860546:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787733807.860564:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787733807.865924:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787733807.865963:0:5813:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787733807.865970:0:5813:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787733807.866140:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787733807.872942:0:5813:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787733807.872951:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787733807.872954:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787733807.872955:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787733807.872957:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787733807.872958:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787733807.872959:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787733807.872960:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787733807.872962:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787733807.872963:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787733807.872964:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787733807.872966:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787733807.872967:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787733807.872972:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787733807.872974:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787733807.872976:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787733807.872977:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787733807.872978:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787733807.872979:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787733807.872979:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787733807.872980:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787733807.872981:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787733807.872982:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787733807.872983:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787733807.872984:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787733807.872985:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787733807.873032:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787733807.873055:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000122f5a2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705688832:0@lo:253: 00000100:00100000:2.0:1787733807.873130:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733807.873211:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000002fa55448 going to sleep for 11 seconds 00000100:00100000:0.0:1787733807.873607:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705688832 00000100:00100000:0.0:1787733807.873615:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705688832 00000100:00100000:0.0:1787733807.873671:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787733807.873680:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000914c5102 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+5:5813:x1874574705688832:12345-0@lo:253: 20000000:01000000:0.0:1787733807.873732:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787733807.873736:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787733807.874117:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787733807.874202:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787733807.874786:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787733807.876059:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787733807.876755:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787733807.876761:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787733807.876767:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787733807.876770:0:5827:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787733807.876786:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787733807.877077:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787733807.877336:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787733807.877351:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787733807.877785:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787733807.877839:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787733807.877876:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787733807.877972:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787733807.877981:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787733807.878038:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787733807.878046:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787733807.878076:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787733807.878083:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787733807.878113:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787733807.883991:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787733807.884101:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787733807.884109:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787733807.884125:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787733807.884550:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787733807.884564:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787733807.884628:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787733807.885618:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787733807.885836:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787733807.885855:0:5827:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787733807.885966:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787733807.885976:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787733807.886042:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787733807.886081:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787733807.886114:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787733807.886126:0:5827:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787733807.890229:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787733807.890257:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787733807.890298:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787733807.890516:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787733807.890955:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787733807.891001:0:5827:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787733807.891009:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787733807.893514:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787733807.894576:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787733807.894829:0:5827:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.134@tcp for mdt 20000000:01000000:0.0:1787733807.894832:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:0.0:1787733807.894875:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787733807.894900:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787733807.894937:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787733807.894946:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:0.0:1787733807.896518:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787733807.896540:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787733807.896594:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787733807.896942:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787733807.897054:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787733807.897057:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787733807.897063:0:5827:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787733807.897069:0:5827:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787733807.898656:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1787733807.899021:0:5827:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787733807.910675:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787733807.910733:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1787733807.910809:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1787733807.910836:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787733807.910839:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787733807.910844:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787733807.910857:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787733807.910860:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787733807.910890:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787733807.910892:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787733807.917109:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1787733807.917562:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1787733807.917608:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1787733807.917833:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1787733807.917850:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787733807.917853:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787733807.921043:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787733807.921484:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787733807.921547:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787733807.921584:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787733807.921601:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787733807.921603:0:5827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787733807.921611:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787733807.921632:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733807.921649:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733807.921672:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733807.921678:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733807.921684:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733807.921690:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733807.921788:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002b19a1cd already unused, calling callback (00000000098c58f0) 00010000:00010000:2.0:1787733807.921791:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733807.921799:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733807.921812:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733807.921819:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733807.921825:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787733807.921842:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787733808.293967:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000914c5102 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+5:5813:x1874574705688832:12345-0@lo:253: Request processed in 420280us (420829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733808.293987:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787733808.294081:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000122f5a2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705688832:0@lo:253: 10000000:01000000:0.0:1787733808.294095:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787733808.294098:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787733808.294100:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787733808.294102:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787733808.294103:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787733808.294104:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787733808.294105:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787733808.294119:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787733808.294121:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787733808.294122:0:5813:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787733808.294123:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787733808.294125:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787733808.294140:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008b12b190 from lustre-MDT0000 10000000:01000000:0.0:1787733808.294188:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787733808.294191:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787733808.294195:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff891ef03219b8 10000000:01000000:0.0:1787733808.294198:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787733808.294205:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff891ef03219b8 from 1 10000000:01000000:0.0:1787733808.294207:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787733808.294251:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.294262:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.294270:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733808.294287:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705688960:0@lo:101: 00000100:00100000:0.0:1787733808.294418:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733808.294464:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000226c02df going to sleep for 11 seconds 00000100:00100000:2.0:1787733808.294522:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705688960 00000100:00100000:2.0:1787733808.294528:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705688960 00000100:00100000:2.0:1787733808.294556:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787733808.294562:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051010c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+5:5813:x1874574705688960:12345-0@lo:101: 00010000:00010000:2.0:1787733808.294574:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733808.294585:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d52a7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733808.294604:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d52a7 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733808.294617:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d52a7 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733808.294626:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b19a1cd, rc 0) 00000100:00100000:2.0:1787733808.294655:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051010c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+6:5813:x1874574705688960:12345-0@lo:101: Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733808.294720:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787733808.294785:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705688960:0@lo:101: 00010000:00010000:0.0:1787733808.294796:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.294804:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733808.294840:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689088:0@lo:501: 00000100:00100000:0.0:1787733808.294865:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733808.294938:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000226c02df going to sleep for 11 seconds 00000100:00100000:2.0:1787733808.295003:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705689088 00000100:00100000:2.0:1787733808.295007:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705689088 00000100:00100000:2.0:1787733808.295059:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787733808.295065:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000feb5abd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+6:5813:x1874574705689088:12345-0@lo:501: 00000100:00100000:2.0:1787733808.295471:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000feb5abd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+6:5813:x1874574705689088:12345-0@lo:501: Request processed in 407us (605us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787733808.295478:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787733808.295566:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689088:0@lo:501: 10000000:01000000:0.0:1787733808.302572:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787733808.302672:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.302686:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733808.302695:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff891ec7b73800 10000000:01000000:1.0:1787733808.302823:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787733808.302830:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff891ec7b73800 10000000:01000000:1.0:1787733808.302833:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787733808.302836:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff891ec7b73800 from 1 10000000:01000000:1.0:1787733808.302839:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787733808.302875:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000009f53b203/0x45228d86de4d52b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.302883:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000009f53b203/0x45228d86de4d52b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.302911:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000009f53b203/0x45228d86de4d52b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733808.302933:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689216:0@lo:101: 00000100:00100000:1.0:1787733808.303012:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733808.303069:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1aba000 going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.303900:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705689216 00000100:00100000:0.0:1787733808.303909:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705689216 00000100:00100000:0.0:1787733808.303964:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787733808.303972:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d679a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+6:5813:x1874574705689216:12345-0@lo:101: 00010000:00010000:0.0:1787733808.303986:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733808.304000:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a4ea1eae/0x45228d86de4d52bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d52b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.304020:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4ea1eae/0x45228d86de4d52bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d52b5 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.304029:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a4ea1eae/0x45228d86de4d52bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d52b5 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.304037:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a4ea1eae, rc 0) 00000100:00100000:0.0:1787733808.304088:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d679a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+7:5813:x1874574705689216:12345-0@lo:101: Request processed in 117us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733808.304095:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787733808.304195:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689216:0@lo:101: 00010000:00010000:1.0:1787733808.304208:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000009f53b203/0x45228d86de4d52b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.304215:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000009f53b203/0x45228d86de4d52b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733808.304230:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787733808.305004:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000009f53b203/0x45228d86de4d52b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.305016:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000009f53b203/0x45228d86de4d52b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733808.305024:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787733808.305029:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787733808.305033:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff891ec7b73800 10000000:01000000:1.0:1787733808.305036:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787733808.305039:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787733808.305042:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787733808.305062:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.305077:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.305084:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733808.305099:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689344:0@lo:101: 00000100:00100000:1.0:1787733808.305135:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733808.305194:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1aba000 going to sleep for 11 seconds 00000100:00100000:3.0:1787733808.305313:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705689344 00000100:00100000:3.0:1787733808.305427:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705689344 00000100:00100000:3.0:1787733808.305478:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787733808.305495:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae94056c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+7:5813:x1874574705689344:12345-0@lo:101: 00010000:00010000:3.0:1787733808.305510:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733808.305521:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9e2e31b/0x45228d86de4d52ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d52c3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.305538:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9e2e31b/0x45228d86de4d52ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d52c3 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.305547:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9e2e31b/0x45228d86de4d52ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d52c3 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.305554:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9e2e31b, rc 0) 00000100:00100000:3.0:1787733808.305589:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae94056c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+8:5813:x1874574705689344:12345-0@lo:101: Request processed in 105us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733808.305595:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787733808.305729:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689344:0@lo:101: 00010000:00010000:1.0:1787733808.305741:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.305748:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733808.305794:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689472:0@lo:501: 00000100:00100000:1.0:1787733808.305819:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733808.305841:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1aba000 going to sleep for 11 seconds 00000100:00100000:3.0:1787733808.306002:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705689472 00000100:00100000:3.0:1787733808.306006:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705689472 00000100:00100000:3.0:1787733808.306035:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787733808.306042:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e04419c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+8:5813:x1874574705689472:12345-0@lo:501: 00000100:00100000:3.0:1787733808.306562:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e04419c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+9:5813:x1874574705689472:12345-0@lo:501: Request processed in 520us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733808.306569:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787733808.306639:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689472:0@lo:501: 00000100:00100000:1.0:1787733808.306667:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689600:0@lo:503: 00000100:00100000:1.0:1787733808.306703:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733808.306771:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1aba000 going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.306983:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705689600 00000100:00100000:0.0:1787733808.306988:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705689600 00000100:00100000:0.0:1787733808.307056:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787733808.307062:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000560f2d4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+9:5813:x1874574705689600:12345-0@lo:503: 00000100:00100000:0.0:1787733808.307249:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000560f2d4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+9:5813:x1874574705689600:12345-0@lo:503: Request processed in 188us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733808.307257:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787733808.307349:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689600:0@lo:503: 00000100:00100000:1.0:1787733808.307879:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:5855:1874574705689728:0@lo:502: 00000100:00100000:1.0:1787733808.307920:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733808.308040:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set 00000000014bd5e4 going to sleep for 11 seconds 00000100:00100000:2.0:1787733808.308099:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705689728 00000100:00100000:2.0:1787733808.308105:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705689728 00000100:00100000:2.0:1787733808.308129:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787733808.308135:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3116a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+9:5855:x1874574705689728:12345-0@lo:502: 00000100:00100000:2.0:1787733808.308581:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3116a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+9:5855:x1874574705689728:12345-0@lo:502: Request processed in 446us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733808.308588:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787733808.308671:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:5855:1874574705689728:0@lo:502: 00000020:01000000:1.0:1787733808.308695:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787733808.308707:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787733808.308709:0:5855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787733808.308714:0:5855:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787733808.308716:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787733808.308730:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000faeb3ac1) 00000020:00000080:1.0:1787733808.308749:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787733808.308755:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787733808.308817:0:5855:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787733808.308824:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d52d8 00000020:00000080:1.0:1787733808.309040:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787733808.309044:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787733808.309047:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787733808.309049:0:5855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787733808.309052:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787733808.309055:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787733808.309056:0:5855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787733808.309058:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787733808.309064:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000015c4c796) 00000020:00000080:1.0:1787733808.309073:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787733808.309077:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787733808.309079:0:5855:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787733808.309082:0:5855:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787733808.309087:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787733808.309121:0:5855:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008b12b190 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787733808.309133:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001b233669) 00000020:00000080:1.0:1787733808.309140:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787733808.311683:0:5855:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787733808.311703:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45228d86de4d52ed 00000020:00000080:1.0:1787733808.312187:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787733808.312196:0:5855:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787733808.312202:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x45228d86de4d52f4 00080000:01000000:1.0:1787733808.312209:0:5855:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787733808.312212:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d52fb 00080000:10000000:1.0:1787733808.312940:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787733808.313198:0:5855:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787733808.321766:0:5855:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787733808.391648:0:5855:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787733808.392058:0:5855:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787733808.395195:0:5855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787733808.395445:0:5855:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787733808.416419:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002f34ddc6) 00000020:00000080:3.0:1787733808.416447:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787733808.416538:0:5855:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787733808.416547:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d5309 00000020:00000080:3.0:1787733808.417877:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787733808.421857:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787733808.470133:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787733808.520600:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787733808.541933:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787733808.561221:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:2.0:1787733808.570263:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787733808.584470:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787733808.599494:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x45228d86de4d5310 00000020:00000080:2.0:1787733808.599846:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787733808.599856:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787733808.599861:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733808.599863:0:5855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787733808.599869:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787733808.599874:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733808.599875:0:5855:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787733808.599878:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787733808.599911:0:5855:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787733808.599923:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787733808.599925:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733808.599926:0:5855:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787733808.599928:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787733808.599929:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733808.599930:0:5855:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787733808.599932:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787733808.599932:0:5855:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787733808.599969:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000debdf174 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:5855:1874574705689856:0@lo:502: 00000100:00100000:2.0:1787733808.600037:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733808.600087:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021676720 going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.600183:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705689856 00000100:00100000:0.0:1787733808.600194:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705689856 00000100:00100000:1.0:1787733808.600265:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787733808.600274:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068f778de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+9:5855:x1874574705689856:12345-0@lo:502: 00000100:00100000:1.0:1787733808.600560:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068f778de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+9:5855:x1874574705689856:12345-0@lo:502: Request processed in 286us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733808.600567:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787733808.600597:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000debdf174 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:5855:1874574705689856:0@lo:502: 00000020:01000000:2.0:1787733808.600624:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787733808.600628:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733808.600630:0:5855:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787733808.600633:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787733808.600800:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787733808.600814:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787733808.600851:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.600861:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733808.600866:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff891ec7b73800 from 1 10000000:01000000:3.0:1787733808.600868:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787733808.600896:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.600901:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.600907:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733808.600916:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c76b72ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689984:0@lo:101: 00000100:00100000:3.0:1787733808.600937:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733808.600963:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b70d6ab0 going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.601007:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705689984 00000100:00100000:0.0:1787733808.601011:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705689984 00000100:00100000:0.0:1787733808.601033:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787733808.601040:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f10f2d8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+9:5813:x1874574705689984:12345-0@lo:101: 00010000:00010000:0.0:1787733808.601049:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733808.601061:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004f4e2742/0x45228d86de4d531e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5317 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.601081:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f4e2742/0x45228d86de4d531e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5317 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.601089:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004f4e2742/0x45228d86de4d531e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5317 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.601097:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004f4e2742, rc 0) 00000100:00100000:0.0:1787733808.601172:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f10f2d8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+10:5813:x1874574705689984:12345-0@lo:101: Request processed in 133us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733808.601176:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787733808.601267:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c76b72ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705689984:0@lo:101: 00010000:00010000:3.0:1787733808.601286:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.601377:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733808.601803:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c76b72ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690112:0@lo:256: 00000100:00100000:3.0:1787733808.601831:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733808.601853:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b70d6ab0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733808.601873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705690112 00000100:00100000:1.0:1787733808.601878:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705690112 00000100:00100000:1.0:1787733808.601909:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787733808.601915:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d25e807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+10:5813:x1874574705690112:12345-0@lo:256: 20000000:01000000:1.0:1787733808.601930:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787733808.601936:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787733808.602004:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d25e807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+10:5813:x1874574705690112:12345-0@lo:256: Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733808.602011:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787733808.602019:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c76b72ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690112:0@lo:256: 10000000:01000000:3.0:1787733808.602646:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787733808.602689:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.602696:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733808.602701:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec7b73800 from 1 10000000:01000000:3.0:1787733808.602703:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787733808.602719:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.602723:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.602729:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733808.602737:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c76b72ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690240:0@lo:101: 00000100:00100000:3.0:1787733808.602765:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733808.602815:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b70d6ab0 going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.602859:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705690240 00000100:00100000:0.0:1787733808.602867:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705690240 00000100:00100000:0.0:1787733808.602892:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787733808.602898:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d29a8a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+10:5813:x1874574705690240:12345-0@lo:101: 00010000:00010000:0.0:1787733808.602906:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733808.602917:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b39bcc8/0x45228d86de4d532c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5325 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.602932:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b39bcc8/0x45228d86de4d532c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5325 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.602941:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b39bcc8/0x45228d86de4d532c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5325 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.602948:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b39bcc8, rc 0) 00000100:00100000:0.0:1787733808.603006:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d29a8a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:5813:x1874574705690240:12345-0@lo:101: Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733808.603010:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787733808.603050:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c76b72ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690240:0@lo:101: 00010000:00010000:3.0:1787733808.603058:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.603062:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733808.603092:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c76b72ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690368:0@lo:501: 00000100:00100000:3.0:1787733808.603107:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733808.603121:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b70d6ab0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733808.603143:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705690368 00000100:00100000:1.0:1787733808.603147:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705690368 00000100:00100000:1.0:1787733808.603194:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787733808.603201:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbeafb89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:5813:x1874574705690368:12345-0@lo:501: 00000100:00100000:1.0:1787733808.603702:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbeafb89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:5813:x1874574705690368:12345-0@lo:501: Request processed in 502us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733808.603718:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787733808.603735:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c76b72ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690368:0@lo:501: 00000100:00100000:3.0:1787733808.603761:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c76b72ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690496:0@lo:503: 00000100:00100000:3.0:1787733808.603797:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733808.603857:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b70d6ab0 going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.603887:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705690496 00000100:00100000:0.0:1787733808.603890:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705690496 00000100:00100000:0.0:1787733808.603910:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787733808.603916:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e39c76a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:5813:x1874574705690496:12345-0@lo:503: 00000040:00080000:0.0:1787733808.603950:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787733808.604021:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e39c76a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:5813:x1874574705690496:12345-0@lo:503: Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733808.604026:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787733808.604070:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c76b72ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690496:0@lo:503: 00000040:00080000:3.0:1787733808.604790:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787733808.604853:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787733808.604869:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787733808.604887:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.604897:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733808.604944:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787733808.604948:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff891ec7b73800 10000000:01000000:1.0:1787733808.604951:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff891ec7b73800 10000000:01000000:1.0:1787733808.604955:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787733808.604960:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891ec7b73800 from 1 10000000:01000000:1.0:1787733808.604963:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787733808.604987:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.604993:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.605003:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733808.605016:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690624:0@lo:101: 00000100:00100000:1.0:1787733808.605049:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733808.605078:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000850ea234 going to sleep for 11 seconds 00000100:00100000:2.0:1787733808.605080:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705690624 00000100:00100000:2.0:1787733808.605085:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705690624 00000100:00100000:2.0:1787733808.605112:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787733808.605119:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d86d06d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:5813:x1874574705690624:12345-0@lo:101: 00010000:00010000:2.0:1787733808.605128:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733808.605139:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000aaf40c0/0x45228d86de4d533a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5333 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733808.605179:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000aaf40c0/0x45228d86de4d533a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5333 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733808.605196:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000aaf40c0/0x45228d86de4d533a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5333 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733808.605204:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000aaf40c0, rc 0) 00000100:00100000:2.0:1787733808.605238:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d86d06d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:5813:x1874574705690624:12345-0@lo:101: Request processed in 120us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733808.605243:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787733808.605256:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690624:0@lo:101: 00010000:00010000:1.0:1787733808.605268:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733808.605282:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733808.605319:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690752:0@lo:501: 00000100:00100000:1.0:1787733808.605343:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733808.605371:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000850ea234 going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.605429:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705690752 00000100:00100000:0.0:1787733808.605433:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705690752 00000100:00100000:0.0:1787733808.605464:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787733808.605470:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b7db347 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5813:x1874574705690752:12345-0@lo:501: 00000100:00100000:0.0:1787733808.605674:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b7db347 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5813:x1874574705690752:12345-0@lo:501: Request processed in 204us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733808.605679:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787733808.605731:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044e653ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690752:0@lo:501: 00000100:00100000:2.0:1787733808.605750:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000debdf174 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690880:0@lo:503: 00000100:00100000:2.0:1787733808.605776:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733808.605792:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bc0d4dc going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.605826:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705690880 00000100:00100000:0.0:1787733808.605828:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705690880 00000100:00100000:0.0:1787733808.605848:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787733808.605852:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d0d4415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:5813:x1874574705690880:12345-0@lo:503: 00000100:00100000:0.0:1787733808.606061:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d0d4415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:5813:x1874574705690880:12345-0@lo:503: Request processed in 208us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733808.606065:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787733808.606121:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000debdf174 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705690880:0@lo:503: 00000100:00100000:2.0:1787733808.606530:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000debdf174 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:5860:1874574705691008:0@lo:502: 00000100:00100000:2.0:1787733808.606555:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733808.606576:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b18ac68 going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.606608:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705691008 00000100:00100000:0.0:1787733808.606612:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705691008 00000100:00100000:0.0:1787733808.606639:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787733808.606645:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cffa44b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:5860:x1874574705691008:12345-0@lo:502: 00000100:00100000:0.0:1787733808.606786:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cffa44b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:5860:x1874574705691008:12345-0@lo:502: Request processed in 138us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733808.606793:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787733808.606810:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000debdf174 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:5860:1874574705691008:0@lo:502: 00000020:01000004:1.0:1787733808.606864:0:5860:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787733808.606888:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e8f4d408) 00000020:00000080:1.0:1787733808.606906:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787733808.606976:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008b12b190 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787733808.606980:0:5860:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008b12b190 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787733808.606982:0:5860:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008b12b190 4 00010000:00080000:1.0:1787733808.607008:0:5860:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003e35788e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1787733808.608322:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787733808.608517:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787733808.608543:0:5860:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787733808.608556:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x45228d86de4d5348 00000100:00080000:1.0:1787733808.608564:0:5860:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787733808.608568:0:5860:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003e35788e using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787733808.608598:0:5860:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e39b879f x1874574705691136/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787733808.608624:0:5860:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787733808.609905:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e39b879f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874574705691136:0@lo:38: 00000100:00100000:3.0:1787733808.609965:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733808.610044:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705691136 00000100:00100000:0.0:1787733808.610049:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705691136 00000100:00100000:0.0:1787733808.610082:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787733808.610088:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c76b72ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874574705691136:12345-0@lo:38: 00000100:00100000:0.0:1787733808.610129:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c76b72ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874574705691136:12345-0@lo:38: Request processed in 41us (164us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787733808.610133:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787733808.611586:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787733808.611611:0:3309:0:(import.c:65:import_set_state_nolock()) 000000003e35788e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787733808.611619:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787733808.611623:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e39b879f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874574705691136:0@lo:38: 00000100:00100000:3.0:1787733808.612118:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053147aa8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:5860:1874574705691264:0@lo:502: 00000100:00100000:3.0:1787733808.612206:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733808.612238:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 00000000391c6713 going to sleep for 11 seconds 00000100:00100000:3.0:1787733808.612253:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705691264 00000100:00100000:3.0:1787733808.612258:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705691264 00000100:00100000:3.0:1787733808.612310:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787733808.612317:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eb581a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:5860:x1874574705691264:12345-0@lo:502: 00000100:00100000:3.0:1787733808.612564:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eb581a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:5860:x1874574705691264:12345-0@lo:502: Request processed in 247us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733808.612571:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787733808.613205:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053147aa8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:5860:1874574705691264:0@lo:502: 00000040:00080000:0.0:1787733808.613233:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787733808.613459:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787733808.613494:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787733808.613513:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733808.613523:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787733808.613566:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787733808.613568:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787733808.613570:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787733808.613574:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787733808.613575:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787733808.613576:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787733808.613577:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787733808.613579:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787733808.613580:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787733808.613581:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787733808.613582:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787733808.613584:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787733808.613588:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787733808.613591:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787733808.613592:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787733808.613593:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787733808.613594:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787733808.613595:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787733808.613665:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787733808.613666:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787733808.613666:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787733808.613667:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787733808.613668:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787733808.613669:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787733808.613670:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787733808.613685:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787733808.613698:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8cf7500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705691392:0@lo:253: 00000100:00100000:2.0:1787733808.613739:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733808.613773:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b9a893a going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.613981:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705691392 00000100:00100000:0.0:1787733808.613990:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705691392 00000100:00100000:0.0:1787733808.614019:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787733808.614026:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000937dd81c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5813:x1874574705691392:12345-0@lo:253: 20000000:01000000:0.0:1787733808.614050:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787733808.614062:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787733808.669760:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787733808.669815:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787733808.672088:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787733808.672097:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787733808.672116:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.672135:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004f4e2742/0x45228d86de4d531e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5317 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.672142:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.672191:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004f4e2742/0x45228d86de4d531e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d5317 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733808.672204:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004f4e2742/0x45228d86de4d531e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d5317 expref: 12 pid: 5827 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733808.672230:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004890754a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1874574705691520:0@lo:104: 00000100:00100000:3.0:1787733808.672304:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733808.672354:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d16fdd3f going to sleep for 11 seconds 00000100:00100000:0.0:1787733808.672673:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705691520 00000100:00100000:0.0:1787733808.672681:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705691520 00000100:00100000:0.0:1787733808.672728:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787733808.672735:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db16464a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+3:5848:x1874574705691520:12345-0@lo:104: 00010000:00010000:0.0:1787733808.672746:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.672794:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787733808.672798:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db16464a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+3:5848:x1874574705691520:12345-0@lo:104: Request processed in 64us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733808.672804:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787733808.672823:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787733808.672827:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.672835:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000676f2350 already unused, calling callback (0000000060045a95) 10000000:00010000:0.0:1787733808.672837:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.672844:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787733808.672849:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733808.672871:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787733808.672892:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.672899:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787733808.672913:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.672919:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 00000000676f2350/0x45228d86de4d5317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d531e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.672937:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733808.672938:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733808.672940:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733808.672990:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705691648:0@lo:103: 00000100:00100000:0.0:1787733808.673015:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733808.673044:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705691648 00000100:00100000:0.0:1787733808.673047:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705691648 00010000:00010000:0.0:1787733808.673060:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004f4e2742/0x45228d86de4d531e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5317 expref: 13 pid: 5827 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733808.673078:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787733808.673082:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000d0440d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+13:3311:x1874574705691648:12345-0@lo:103: 00010000:00010000:0.0:1787733808.673091:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733808.673094:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004f4e2742/0x45228d86de4d531e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5317 expref: 13 pid: 5827 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673103:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004f4e2742/0x45228d86de4d531e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d5317 expref: 13 pid: 5827 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673121:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673128:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787733808.673139:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001042225s 00010000:00010000:0.0:1787733808.673142:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673148:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673183:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673189:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673194:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000073820b81 already unused, calling callback (00000000098c58f0) 00010000:00010000:0.0:1787733808.673197:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673202:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673209:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673217:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733808.673239:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000d0440d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+13:3311:x1874574705691648:12345-0@lo:103: Request processed in 157us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733808.673249:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787733808.673346:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705691648:0@lo:103: 00010000:00010000:0.0:1787733808.673373:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004f4e2742/0x45228d86de4d531e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d5317 expref: 12 pid: 5827 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733808.673382:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004890754a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1874574705691520:0@lo:104: 00010000:00010000:0.0:1787733808.673391:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673398:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673402:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733808.673407:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000073820b81/0x45228d86de4d534f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733808.678187:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000937dd81c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:5813:x1874574705691392:12345-0@lo:253: Request processed in 64151us (64436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733808.678218:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787733808.678406:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8cf7500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:5813:1874574705691392:0@lo:253: 10000000:01000000:0.0:1787733808.678422:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787733808.678426:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787733808.678428:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787733808.678430:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787733808.678431:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787733808.678432:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787733808.678434:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787733808.678435:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787733808.678437:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787733808.678438:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787733808.678439:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787733808.678441:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787733808.678448:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787733808.678465:0:5813:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787733808.684761:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787733808.685125:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787733808.685351:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787733808.685543:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787733808.685748:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787733808.685919:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787733808.687472:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787733808.687699:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787733808.687887:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787733808.688051:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787733808.688389:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787733808.688596:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787733808.733720:0:5813:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787733808.763148:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787733808.763575:0:5865:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787733808.763580:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787733808.763656:0:5866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787733808.766270:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787733808.766433:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787733808.766878:0:5813:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787733808.766886:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787733808.767016:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787733808.768994:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787733808.769803:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787733808.769834:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787733808.770133:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787733808.770628:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787733808.771936:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787733808.772090:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787733808.772277:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787733808.772609:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787733808.772750:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787733808.773149:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787733808.773397:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787733808.773565:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787733808.773698:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787733808.773856:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787733808.774007:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787733808.774188:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787733808.774472:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787733808.774635:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787733808.774778:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787733808.774916:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787733808.775206:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787733808.778693:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787733808.778920:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787733808.779069:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787733808.779226:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787733808.780715:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787733808.780878:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787733808.781050:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787733808.781225:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787733808.781443:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787733808.781604:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787733808.781773:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787733808.781926:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787733808.782084:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787733808.782273:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787733808.783044:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787733808.783255:0:5813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787733808.804411:0:5866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787733808.847147:0:5813:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787733808.847210:0:5813:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb062c1c6f988 00100000:10000000:2.0:1787733808.847220:0:5813:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787733808.847856:0:5813:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787733808.847869:0:5813:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787733808.847885:0:5813:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787733808.847908:0:5813:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787733808.899182:0:5866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787733808.899263:0:5866:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787733808.899267:0:5866:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787733809.597867:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733810.619911:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733811.647188:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733812.666510:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733813.692388:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787733813.923625:0:6109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787733814.081793:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787733814.081804:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787733814.081817:0:38:0:(import.c:65:import_set_state_nolock()) 000000003e35788e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787733814.081830:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003e35788e using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787733814.081850:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dda9265f x1874574705691904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787733814.081884:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dda9265f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874574705691904:0@lo:38: 00000100:00100000:2.0:1787733814.081947:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733814.082026:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705691904 00000100:00100000:2.0:1787733814.082035:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705691904 00000100:00100000:3.0:1787733814.082527:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078c60cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705691776:0@lo:400: 00000100:00100000:3.0:1787733814.082562:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733814.083908:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705691776 00000100:00100000:1.0:1787733814.083918:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705691776 00000100:00100000:1.0:1787733814.083959:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787733814.083967:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc9f75f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+11:3312:x1874574705691776:12345-0@lo:400: 00000100:00100000:1.0:1787733814.084029:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc9f75f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+11:3312:x1874574705691776:12345-0@lo:400: Request processed in 62us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733814.084036:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787733814.084081:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078c60cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705691776:0@lo:400: 00000100:00100000:2.0:1787733814.092944:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787733814.092956:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004915e666 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874574705691904:12345-0@lo:38: 00010000:00080000:2.0:1787733814.092986:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:2.0:1787733814.093023:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x45228d86de4d5356 00000004:00100000:2.0:1787733814.093067:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787733814.093185:0:5834:0:(import.c:65:import_set_state_nolock()) 000000001208b86d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787733814.093265:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004915e666 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874574705691904:12345-0@lo:38: Request processed in 308us (11317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733814.093272:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787733814.093329:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dda9265f x1874574705691904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787733824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787733814.093345:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787733814.093351:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787733814.093356:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787733814.093358:0:3309:0:(import.c:65:import_set_state_nolock()) 000000003e35788e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787733814.093370:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dda9265f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874574705691904:0@lo:38: 00010000:00010000:3.0:1787733814.715114:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787733815.610290:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787733815.610299:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff891ec7b73800 from 3 10000000:01000000:0.0:1787733815.610305:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787733815.610351:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000004f4e2742/0x45228d86de4d535d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733815.610378:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000004f4e2742/0x45228d86de4d535d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733815.610389:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000004f4e2742/0x45228d86de4d535d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733815.610425:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705692032:0@lo:101: 00000100:00100000:0.0:1787733815.610495:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733815.610571:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f31dfea going to sleep for 11 seconds 00000100:00100000:3.0:1787733815.610691:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705692032 00000100:00100000:3.0:1787733815.610700:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705692032 00000100:00100000:3.0:1787733815.610755:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787733815.610764:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d1155f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:5829:x1874574705692032:12345-0@lo:101: 00010000:00010000:3.0:1787733815.610776:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733815.610788:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb4b28a7/0x45228d86de4d5364 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d535d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733815.610808:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb4b28a7/0x45228d86de4d5364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d535d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733815.610818:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb4b28a7/0x45228d86de4d5364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d535d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733815.610838:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb4b28a7, rc 0) 00000100:00100000:3.0:1787733815.610891:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d1155f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705692032:12345-0@lo:101: Request processed in 128us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733815.610900:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787733815.610918:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705692032:0@lo:101: 00010000:00010000:0.0:1787733815.610933:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000004f4e2742/0x45228d86de4d535d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733815.610942:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000004f4e2742/0x45228d86de4d535d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733815.610997:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705692160:0@lo:256: 00000100:00100000:0.0:1787733815.611029:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733815.611103:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f31dfea going to sleep for 11 seconds 00000100:00100000:2.0:1787733815.611264:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705692160 00000100:00100000:2.0:1787733815.611269:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705692160 00000100:00100000:2.0:1787733815.611304:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787733815.611311:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4019f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705692160:12345-0@lo:256: 20000000:01000000:2.0:1787733815.611331:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787733815.611350:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787733815.611353:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787733815.611606:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4019f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705692160:12345-0@lo:256: Request processed in 294us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733815.611613:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787733815.611668:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705692160:0@lo:256: 10000000:01000000:0.0:1787733815.611708:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787733815.611713:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000004f4e2742/0x45228d86de4d535d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733815.611720:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000004f4e2742/0x45228d86de4d535d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733815.738553:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733816.764305:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733817.786254:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787733818.094459:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd29e6e570 20000000:00000080:3.0:1787733818.094479:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff891ef67cdc00 uarg=0000000000000000 20000000:01000000:3.0:1787733818.094514:0:6311:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787733818.094521:0:6311:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787733818.094526:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787733818.094727:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787733818.094738:0:6311:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787733818.102822:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787733818.103080:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787733818.103137:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787733818.104405:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787733818.104430:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787733818.104448:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733818.104650:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006b39bcc8/0x45228d86de4d532c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5325 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733818.104659:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733818.104699:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006b39bcc8/0x45228d86de4d532c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d5325 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733818.104714:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006b39bcc8/0x45228d86de4d532c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d5325 expref: 11 pid: 5827 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733818.104738:0:6311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c6b410c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1874574705692288:0@lo:104: 00000100:00100000:3.0:1787733818.104800:0:6311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733818.105195:0:6311:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5e20758 going to sleep for 11 seconds 00000100:00100000:2.0:1787733818.107771:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705692288 00000100:00100000:2.0:1787733818.107786:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705692288 00000100:00100000:2.0:1787733818.107836:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787733818.107845:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c70e013e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:6311:x1874574705692288:12345-0@lo:104: 00010000:00010000:2.0:1787733818.107862:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.107960:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787733818.107966:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c70e013e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:6311:x1874574705692288:12345-0@lo:104: Request processed in 122us (3166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733818.107973:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787733818.107996:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787733818.108001:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108009:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b6f1d9a2 already unused, calling callback (0000000060045a95) 10000000:00010000:2.0:1787733818.108025:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108033:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787733818.108040:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787733818.108045:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787733818.108081:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108088:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787733818.108105:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108111:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 00000000b6f1d9a2/0x45228d86de4d5325 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d532c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108131:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733818.108133:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733818.108135:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733818.108179:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dda9265f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705692416:0@lo:103: 00000100:00100000:2.0:1787733818.108214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733818.108264:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705692416 00000100:00100000:2.0:1787733818.108268:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705692416 00010000:00010000:2.0:1787733818.108284:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006b39bcc8/0x45228d86de4d532c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5325 expref: 12 pid: 5827 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733818.108306:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787733818.108332:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dd1c45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+12:3313:x1874574705692416:12345-0@lo:103: 00010000:00010000:2.0:1787733818.108342:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733818.108347:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006b39bcc8/0x45228d86de4d532c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5325 expref: 12 pid: 5827 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108356:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006b39bcc8/0x45228d86de4d532c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d5325 expref: 12 pid: 5827 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108372:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108380:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108392:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108399:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108405:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108411:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108416:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001c118a3a already unused, calling callback (00000000098c58f0) 00010000:00010000:2.0:1787733818.108419:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108425:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108440:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.108450:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733818.108494:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dd1c45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+12:3313:x1874574705692416:12345-0@lo:103: Request processed in 163us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733818.108500:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787733818.108534:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dda9265f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705692416:0@lo:103: 00010000:00010000:3.0:1787733818.108892:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006b39bcc8/0x45228d86de4d532c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d5325 expref: 11 pid: 5827 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733818.108904:0:6311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c6b410c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1874574705692288:0@lo:104: 00010000:00010000:3.0:1787733818.108918:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733818.108926:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733818.108932:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733818.108937:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001c118a3a/0x45228d86de4d536b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733818.810464:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733819.194990:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c92057d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705692672:0@lo:400: 00000100:00100000:1.0:1787733819.195078:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733819.195197:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787733819.195205:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dda9265f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705692544:0@lo:400: 00000100:00100000:1.0:1787733819.195236:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733819.195291:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705692544 00000100:00100000:1.0:1787733819.195308:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705692544 00000100:00100000:1.0:1787733819.195353:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787733819.195362:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d94f4da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+11:3311:x1874574705692544:12345-0@lo:400: 00000100:00100000:1.0:1787733819.195418:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d94f4da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+11:3311:x1874574705692544:12345-0@lo:400: Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733819.195426:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787733819.196254:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705692672 00000100:00100000:2.0:1787733819.196264:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705692672 00000100:00100000:2.0:1787733819.196309:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787733819.196316:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000991d3fe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705692672:12345-0@lo:400: 00000100:00100000:2.0:1787733819.196363:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000991d3fe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705692672:12345-0@lo:400: Request processed in 48us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733819.196370:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787733819.197213:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dda9265f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705692544:0@lo:400: 00010000:00080000:1.0:1787733819.197231:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006c92057d x1874574705692672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733819.197244:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c92057d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705692672:0@lo:400: 00010000:00010000:2.0:1787733819.834436:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733820.860684:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733821.897861:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733822.906467:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787733823.598485:0:6677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787733823.598489:0:6677:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787733823.598731:0:6677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000089963795 00000020:01000004:2.0:1787733823.598750:0:6677:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787733823.598763:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787733823.598776:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000be4da1de) 00000020:00000080:2.0:1787733823.598791:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787733823.631013:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787733823.631406:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787733823.661842:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787733823.675708:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787733823.675777:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787733823.675856:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787733823.675883:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787733823.676666:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787733823.676679:0:6677:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787733823.676690:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x45228d86de4d5379 00000020:01000004:2.0:1787733823.676698:0:6677:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787733823.676720:0:6677:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787733823.676723:0:6677:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787733823.676729:0:6677:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787733823.676734:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787733823.676746:0:6677:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000042986d90) 00000020:00000080:2.0:1787733823.676758:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787733823.678340:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787733823.678995:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787733823.679002:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787733823.684042:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787733823.684059:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787733823.684684:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787733823.684691:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787733823.686365:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787733823.686743:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787733823.686749:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787733823.691310:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787733823.691326:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787733823.726134:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787733823.726798:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787733823.726806:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787733823.728811:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787733823.728824:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787733823.730701:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787733823.730716:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787733823.734302:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787733823.734632:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787733823.734639:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787733823.735852:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787733823.735861:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787733823.792019:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787733823.792356:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787733823.792378:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787733823.797266:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787733823.797281:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787733823.797884:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787733823.797907:0:6677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787733823.797912:0:6677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787733823.828493:0:6677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787733823.828527:0:6677:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787733823.828531:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787733823.828533:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787733823.828534:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787733823.828536:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787733823.828537:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787733823.828538:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787733823.828540:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787733823.828541:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787733823.828542:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787733823.828544:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787733823.828545:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787733823.828549:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787733823.828551:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787733823.828553:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787733823.828554:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787733823.828555:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787733823.828556:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787733823.828557:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787733823.828557:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787733823.828558:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787733823.828559:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787733823.828560:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787733823.828561:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787733823.828586:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787733823.828606:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009487a9a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705692800:0@lo:253: 00000100:00100000:2.0:1787733823.828665:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733823.828710:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1bfa765 going to sleep for 11 seconds 00000100:00100000:1.0:1787733823.829066:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705692800 00000100:00100000:1.0:1787733823.829075:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705692800 00000100:00100000:1.0:1787733823.829129:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787733823.829139:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026cbb708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705692800:12345-0@lo:253: 20000000:01000000:1.0:1787733823.829366:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787733823.829371:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787733823.829377:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787733823.829381:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787733823.836855:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787733823.837151:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787733823.837393:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787733823.837617:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787733823.837764:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787733823.837804:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787733823.837860:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787733823.847916:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787733823.847957:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:0.0:1787733823.847961:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:0.0:1787733823.848021:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787733823.848033:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787733823.848097:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787733823.848106:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:0.0:1787733823.848152:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787733823.848340:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787733823.848391:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787733823.848591:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787733823.850364:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787733823.850396:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:0.0:1787733823.850399:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:0.0:1787733823.850520:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787733823.850530:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787733823.850717:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787733823.850727:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:0.0:1787733823.850987:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787733823.850999:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787733823.851031:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787733823.851070:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787733823.851087:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787733823.851090:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787733823.851096:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787733823.851098:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787733823.851101:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787733823.851113:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787733823.851115:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787733823.851152:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787733823.851267:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787733823.854812:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787733823.854917:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787733823.854970:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787733823.855492:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787733823.855549:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787733823.855703:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787733823.855718:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787733823.855720:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787733823.857045:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1787733823.857113:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1787733823.858283:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787733823.859338:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787733823.859401:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787733823.859829:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1787733823.859846:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787733823.859848:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787733823.860393:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787733823.861103:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787733823.861142:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787733823.861417:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1787733823.861446:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787733823.861465:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.861485:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d52a7 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.861492:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a9e2e31b/0x45228d86de4d52ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d52c3 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.861498:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000aaf40c0/0x45228d86de4d533a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5333 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.861886:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.861943:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000aaf40c0/0x45228d86de4d533a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d5333 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.861963:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000aaf40c0/0x45228d86de4d533a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d5333 expref: 11 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733823.861982:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705692928:0@lo:104: 00000100:00100000:0.0:1787733823.862091:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787733823.862255:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a9e2e31b/0x45228d86de4d52ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d52c3 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.862273:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a9e2e31b/0x45228d86de4d52ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d52c3 expref: 11 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733823.862282:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008888b2df pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705693056:0@lo:104: 00000100:00100000:0.0:1787733823.862306:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787733823.862987:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d52a7 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.862998:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d52a7 expref: 11 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733823.863007:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb26ea64 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705693184:0@lo:104: 00000100:00100000:0.0:1787733823.863032:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733823.863054:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705692928 00000100:00100000:2.0:1787733823.863062:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705692928 00000100:00100000:1.0:1787733823.863141:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705693056 00000100:00100000:1.0:1787733823.863147:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705693056 00000100:00100000:1.0:1787733823.863205:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787733823.863224:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbca7483 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+4:5826:x1874574705692928:12345-0@lo:104: 00010000:00010000:1.0:1787733823.863245:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733823.863305:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787733823.863310:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbca7483 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+4:5826:x1874574705692928:12345-0@lo:104: Request processed in 99us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733823.863318:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787733823.863340:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787733823.863345:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000360fce61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+3:5826:x1874574705693056:12345-0@lo:104: 00010000:00010000:1.0:1787733823.863352:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733823.863382:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787733823.863387:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000360fce61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+3:5826:x1874574705693056:12345-0@lo:104: Request processed in 43us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733823.863392:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787733823.863469:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787733823.863475:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863483:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd9676e6 already unused, calling callback (0000000060045a95) 10000000:00010000:3.0:1787733823.863486:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863494:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733823.863501:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733823.863518:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733823.863555:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863567:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733823.863587:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863594:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 00000000dd9676e6/0x45228d86de4d5333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d533a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863631:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787733823.863634:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863647:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000011726141 already unused, calling callback (0000000060045a95) 10000000:00010000:3.0:1787733823.863649:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863656:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733823.863661:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733823.863665:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733823.863679:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863690:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733823.863695:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863700:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 0000000011726141/0x45228d86de4d52c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d52ca expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863711:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733823.863713:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733823.863714:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733823.863720:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733823.863763:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c6b410c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705693312:0@lo:103: 00000100:00100000:3.0:1787733823.863799:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733823.863827:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787733823.863833:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ad7d6f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705693440:0@lo:103: 00000100:00100000:3.0:1787733823.863853:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733823.863888:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705693312 00000100:00100000:3.0:1787733823.863893:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705693312 00010000:00010000:3.0:1787733823.863913:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000aaf40c0/0x45228d86de4d533a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5333 expref: 12 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733823.863935:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705693440 00000100:00100000:3.0:1787733823.863937:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705693440 00010000:00010000:3.0:1787733823.863947:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a9e2e31b/0x45228d86de4d52ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d52c3 expref: 13 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733823.863959:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787733823.863963:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091572775 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+13:3312:x1874574705693312:12345-0@lo:103: 00010000:00010000:3.0:1787733823.863973:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733823.863976:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000aaf40c0/0x45228d86de4d533a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5333 expref: 13 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.863985:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000aaf40c0/0x45228d86de4d533a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d5333 expref: 13 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.864002:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733823.864027:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091572775 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+13:3312:x1874574705693312:12345-0@lo:103: Request processed in 63us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733823.864033:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787733823.864046:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787733823.864050:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077d22740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+12:3312:x1874574705693440:12345-0@lo:103: 00010000:00010000:3.0:1787733823.864064:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733823.864068:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a9e2e31b/0x45228d86de4d52ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d52c3 expref: 12 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.864078:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a9e2e31b/0x45228d86de4d52ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d52c3 expref: 12 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.864087:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733823.864106:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077d22740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+12:3312:x1874574705693440:12345-0@lo:103: Request processed in 56us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733823.864112:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787733823.864148:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ad7d6f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705693440:0@lo:103: 00000100:00100000:3.0:1787733823.864175:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c6b410c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705693312:0@lo:103: 00000100:00100000:0.0:1787733823.864673:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e5affac going to sleep for 11 seconds 00010000:00010000:0.0:1787733823.864689:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000aaf40c0/0x45228d86de4d533a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d5333 expref: 11 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733823.864703:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f3f0a44 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705692928:0@lo:104: 00010000:00010000:0.0:1787733823.864712:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a9e2e31b/0x45228d86de4d52ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d52c3 expref: 10 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733823.864722:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008888b2df pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705693056:0@lo:104: 00000100:00100000:2.0:1787733823.864887:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705693184 00000100:00100000:2.0:1787733823.864893:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705693184 00000100:00100000:2.0:1787733823.864913:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787733823.864919:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001575eaed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:5826:x1874574705693184:12345-0@lo:104: 00010000:00010000:2.0:1787733823.864928:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733823.864987:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787733823.864992:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001575eaed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:5826:x1874574705693184:12345-0@lo:104: Request processed in 74us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733823.864998:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787733823.865066:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787733823.865071:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865077:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d0642144 already unused, calling callback (0000000060045a95) 10000000:00010000:3.0:1787733823.865080:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865087:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733823.865093:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733823.865098:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733823.865133:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865146:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733823.865186:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865192:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 00000000d0642144/0x45228d86de4d52a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d52ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865206:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733823.865207:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733823.865208:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733823.865232:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c6b410c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705693568:0@lo:103: 00000100:00100000:3.0:1787733823.865264:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733823.865295:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705693568 00000100:00100000:3.0:1787733823.865299:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705693568 00010000:00010000:3.0:1787733823.865313:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d52a7 expref: 10 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733823.865331:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787733823.865336:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ad7d6f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+10:3310:x1874574705693568:12345-0@lo:103: 00010000:00010000:3.0:1787733823.865344:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733823.865348:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d52a7 expref: 10 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865356:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d52a7 expref: 10 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865369:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865387:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865399:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865405:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865411:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865416:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865620:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000033a3af59 already unused, calling callback (00000000098c58f0) 00010000:00010000:3.0:1787733823.865624:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865631:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865703:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.865714:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733823.865842:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ad7d6f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+10:3310:x1874574705693568:12345-0@lo:103: Request processed in 505us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733823.865849:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787733823.865947:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b19a1cd/0x45228d86de4d52ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d52a7 expref: 9 pid: 5826 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733823.865956:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb26ea64 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705693184:0@lo:104: 00010000:00010000:0.0:1787733823.865975:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.865991:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.865996:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.866001:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000033a3af59/0x45228d86de4d5387 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787733823.866014:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787733823.868026:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c6b410c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705693568:0@lo:103: 00010000:00010000:0.0:1787733823.931916:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733823.949833:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026cbb708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+8:6677:x1874574705692800:12345-0@lo:253: Request processed in 120687us (121157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733823.949869:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787733823.949980:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009487a9a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705692800:0@lo:253: 10000000:01000000:2.0:1787733823.949995:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787733823.950000:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787733823.950002:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787733823.950003:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787733823.950004:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787733823.950006:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787733823.950007:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787733823.950008:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787733823.950009:0:6677:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787733823.950011:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787733823.950013:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787733823.950043:0:6677:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000089963795 from lustre-OST0000 10000000:01000000:2.0:1787733823.950070:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787733823.950073:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787733823.950080:0:6677:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff891ef03219b8 local copy 10000000:01000000:2.0:1787733823.950084:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787733823.950121:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733823.950143:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733823.950152:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733823.950194:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009487a9a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705693696:0@lo:101: 00000100:00100000:2.0:1787733823.950242:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733823.950302:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf1e4173 going to sleep for 11 seconds 00000100:00100000:3.0:1787733823.950423:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705693696 00000100:00100000:3.0:1787733823.950430:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705693696 00000100:00100000:3.0:1787733823.950475:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787733823.950483:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067ef6abf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+8:6677:x1874574705693696:12345-0@lo:101: 00010000:00010000:3.0:1787733823.950496:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733823.950508:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001c118a3a/0x45228d86de4d5395 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d538e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.950529:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c118a3a/0x45228d86de4d5395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d538e expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.950540:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001c118a3a/0x45228d86de4d5395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d538e expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.950548:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001c118a3a, rc 0) 00000100:00100000:3.0:1787733823.950599:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067ef6abf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+9:6677:x1874574705693696:12345-0@lo:101: Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733823.950767:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787733823.950852:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009487a9a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705693696:0@lo:101: 00010000:00010000:0.0:1787733823.950866:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.950874:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733823.950982:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb26ea64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705693824:0@lo:501: 00000100:00100000:0.0:1787733823.951014:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733823.951196:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd6c74dd going to sleep for 11 seconds 00000100:00100000:3.0:1787733823.951259:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705693824 00000100:00100000:3.0:1787733823.951264:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705693824 00000100:00100000:3.0:1787733823.951333:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787733823.951340:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b60b2233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+9:6677:x1874574705693824:12345-0@lo:501: 00000100:00100000:3.0:1787733823.951549:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b60b2233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+9:6677:x1874574705693824:12345-0@lo:501: Request processed in 210us (534us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787733823.951726:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787733823.951912:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb26ea64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705693824:0@lo:501: 10000000:01000000:0.0:1787733823.951928:0:6677:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787733823.951954:0:6677:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787733823.951959:0:6677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.951976:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.951983:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.952103:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787733823.952125:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff891ec73ed000 10000000:01000000:0.0:1787733823.952130:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787733823.952135:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff891ef03219b8 10000000:01000000:0.0:1787733823.952138:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787733823.952141:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff891ef03219b8 from 1 10000000:01000000:0.0:1787733823.952144:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787733823.952199:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000033a3af59/0x45228d86de4d539c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.952206:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000033a3af59/0x45228d86de4d539c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.952222:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000033a3af59/0x45228d86de4d539c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733823.952237:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb26ea64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705693952:0@lo:101: 00000100:00100000:0.0:1787733823.952269:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733823.952301:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3615fde going to sleep for 11 seconds 00000100:00100000:2.0:1787733823.952395:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705693952 00000100:00100000:2.0:1787733823.952400:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705693952 00000100:00100000:2.0:1787733823.952434:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787733823.952441:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e73f635f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+9:6677:x1874574705693952:12345-0@lo:101: 00010000:00010000:2.0:1787733823.952450:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733823.952460:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a56b1375/0x45228d86de4d53a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d539c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733823.952477:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a56b1375/0x45228d86de4d53a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d539c expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733823.952487:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a56b1375/0x45228d86de4d53a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d539c expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733823.952495:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a56b1375, rc 0) 00000100:00100000:2.0:1787733823.952530:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e73f635f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705693952:12345-0@lo:101: Request processed in 90us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733823.952536:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787733823.952752:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb26ea64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705693952:0@lo:101: 00010000:00010000:0.0:1787733823.952763:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000033a3af59/0x45228d86de4d539c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53a3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.952783:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000033a3af59/0x45228d86de4d539c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d53a3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733823.952797:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787733823.952808:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000033a3af59/0x45228d86de4d539c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53a3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.952814:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000033a3af59/0x45228d86de4d539c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53a3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733823.952820:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787733823.952824:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787733823.952828:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787733823.952829:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787733823.952841:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000005153d69d/0x45228d86de4d53aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.952847:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000005153d69d/0x45228d86de4d53aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.952853:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000005153d69d/0x45228d86de4d53aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733823.952863:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb26ea64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694080:0@lo:101: 00000100:00100000:0.0:1787733823.952887:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733823.952901:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3615fde going to sleep for 11 seconds 00000100:00100000:0.0:1787733823.953144:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705694080 00000100:00100000:0.0:1787733823.953150:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705694080 00010000:00010000:3.0:1787733823.953343:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787733823.953349:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.953365:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007e8f6c70 already unused, calling callback (0000000060045a95) 10000000:00010000:3.0:1787733823.953368:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.953374:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733823.953380:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733823.953385:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733823.953407:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.953413:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733823.953431:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.953437:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 000000007e8f6c70/0x45228d86de4d538e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x45228d86de4d5395 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.953451:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733823.953453:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733823.953455:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733823.953466:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705694208:0@lo:103: 00000100:00100000:3.0:1787733823.953497:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733823.953542:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705694208 00000100:00100000:3.0:1787733823.953546:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705694208 00000100:00100000:3.0:1787733823.953789:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787733823.953804:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000965cdd02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+11:3311:x1874574705694208:12345-0@lo:103: 00010000:00010000:3.0:1787733823.953815:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733823.953828:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001c118a3a/0x45228d86de4d5395 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d538e expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.953844:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733823.953875:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000965cdd02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+10:3311:x1874574705694208:12345-0@lo:103: Request processed in 74us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733823.953881:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787733823.953908:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705694208:0@lo:103: 00000100:00100000:0.0:1787733823.954092:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787733823.954100:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cfc2192 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+9:6677:x1874574705694080:12345-0@lo:101: 00010000:00010000:0.0:1787733823.954109:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733823.954119:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b39bcc8/0x45228d86de4d53b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d53aa expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.954132:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b39bcc8/0x45228d86de4d53b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d53aa expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.954141:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b39bcc8/0x45228d86de4d53b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d53aa expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733823.954147:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b39bcc8, rc 0) 00000100:00100000:0.0:1787733823.954219:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cfc2192 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705694080:12345-0@lo:101: Request processed in 111us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733823.954225:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787733823.954304:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb26ea64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694080:0@lo:101: 00010000:00010000:3.0:1787733823.954316:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000005153d69d/0x45228d86de4d53aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.954323:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000005153d69d/0x45228d86de4d53aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733823.954415:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694336:0@lo:501: 00000100:00100000:3.0:1787733823.954440:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733823.954591:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9c7dea3 going to sleep for 11 seconds 00000100:00100000:1.0:1787733823.954785:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705694336 00000100:00100000:1.0:1787733823.954791:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705694336 00000100:00100000:1.0:1787733823.954815:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787733823.954821:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c80f3940 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705694336:12345-0@lo:501: 00000100:00100000:1.0:1787733823.955126:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c80f3940 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705694336:12345-0@lo:501: Request processed in 304us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733823.955133:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787733823.955333:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694336:0@lo:501: 00000100:00100000:3.0:1787733823.955377:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694464:0@lo:503: 00000100:00100000:3.0:1787733823.955415:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733823.955437:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9c7dea3 going to sleep for 11 seconds 00000100:00100000:1.0:1787733823.955490:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705694464 00000100:00100000:1.0:1787733823.955495:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705694464 00000100:00100000:1.0:1787733823.955522:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787733823.955529:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020079e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705694464:12345-0@lo:503: 00000100:00100000:1.0:1787733823.955907:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020079e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705694464:12345-0@lo:503: Request processed in 378us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733823.955915:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787733823.955992:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694464:0@lo:503: 00000040:00080000:3.0:1787733823.956429:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787733823.956496:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694592:0@lo:502: 00000100:00100000:3.0:1787733823.956535:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733823.956822:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9c7dea3 going to sleep for 11 seconds 00000100:00100000:0.0:1787733823.956993:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705694592 00000100:00100000:0.0:1787733823.957002:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705694592 00000100:00100000:2.0:1787733823.957144:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787733823.957192:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000648c72f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705694592:12345-0@lo:502: 00000100:00100000:2.0:1787733823.957393:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000648c72f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705694592:12345-0@lo:502: Request processed in 206us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733823.957401:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787733823.957500:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694592:0@lo:502: 00000040:00080000:3.0:1787733823.957923:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787733823.957975:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787733823.958009:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787733823.958133:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787733823.958199:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787733823.958243:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787733823.958274:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694720:0@lo:502: 00000100:00100000:3.0:1787733823.958326:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733823.958417:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9c7dea3 going to sleep for 11 seconds 00000100:00100000:0.0:1787733823.958486:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705694720 00000100:00100000:0.0:1787733823.958492:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705694720 00000100:00100000:0.0:1787733823.958515:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787733823.958522:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089d11e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705694720:12345-0@lo:502: 00000100:00100000:0.0:1787733823.958885:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089d11e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705694720:12345-0@lo:502: Request processed in 363us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733823.958893:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787733823.959088:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694720:0@lo:502: 00000040:00080000:3.0:1787733823.959254:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787733823.959264:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787733823.961273:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787733823.961288:0:6696:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787733823.961298:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787733823.961301:0:6696:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787733823.961310:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787733823.961325:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000a5d0d1c6) 00000020:00000080:1.0:1787733823.961351:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787733823.961357:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787733823.961847:0:6696:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000089963795 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787733823.961858:0:6696:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787733823.961876:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x45228d86de4d53bf 00010000:00010000:0.0:1787733823.973112:0:6696:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787733823.973487:0:6696:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787733823.978581:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787733823.979270:0:6696:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787733823.994865:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787733823.995395:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787733823.997576:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787733823.997595:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787733823.999747:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733823.999754:0:6696:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787733823.999765:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787733823.999770:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733823.999772:0:6696:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787733823.999775:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787733823.999778:0:6696:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787733823.999846:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787733823.999849:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733823.999850:0:6696:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787733823.999859:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787733823.999936:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787733823.999959:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787733823.999976:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000005153d69d/0x45228d86de4d53aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733823.999991:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000005153d69d/0x45228d86de4d53aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733823.999999:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec73ed000 from 1 10000000:01000000:3.0:1787733824.000002:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787733824.000172:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000001c118a3a/0x45228d86de4d53c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.000180:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000001c118a3a/0x45228d86de4d53c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.000190:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000001c118a3a/0x45228d86de4d53c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733824.000225:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694848:0@lo:101: 00000100:00100000:3.0:1787733824.000307:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.000362:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 000000003bf66caf going to sleep for 11 seconds 00000100:00100000:3.0:1787733824.003382:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705694848 00000100:00100000:3.0:1787733824.003399:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705694848 00000100:00100000:3.0:1787733824.003462:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787733824.003473:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d0ad169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+10:6677:x1874574705694848:12345-0@lo:101: 00010000:00010000:3.0:1787733824.003491:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733824.003510:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f6d7008d/0x45228d86de4d53cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d53c6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.003584:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6d7008d/0x45228d86de4d53cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d53c6 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.004145:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f6d7008d/0x45228d86de4d53cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d53c6 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.004299:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f6d7008d, rc 0) 00000100:00100000:3.0:1787733824.004382:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d0ad169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705694848:12345-0@lo:101: Request processed in 911us (4075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733824.004389:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787733824.004756:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f0cace pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694848:0@lo:101: 00010000:00010000:2.0:1787733824.004777:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000001c118a3a/0x45228d86de4d53c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733824.004788:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000001c118a3a/0x45228d86de4d53c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733824.004957:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aba72bf2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694976:0@lo:501: 00000100:00100000:2.0:1787733824.005803:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733824.005848:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 000000006484c59b going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.005959:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705694976 00000100:00100000:1.0:1787733824.005967:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705694976 00000100:00100000:1.0:1787733824.006019:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787733824.006089:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003564caf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705694976:12345-0@lo:501: 00000100:00100000:1.0:1787733824.006506:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003564caf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705694976:12345-0@lo:501: Request processed in 419us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.006515:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787733824.011350:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aba72bf2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705694976:0@lo:501: 00000100:00100000:3.0:1787733824.011414:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000375bd533 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695104:0@lo:503: 00000100:00100000:3.0:1787733824.011491:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.011528:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000849900dc going to sleep for 11 seconds 00000100:00100000:2.0:1787733824.011596:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705695104 00000100:00100000:2.0:1787733824.011752:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705695104 00000100:00100000:2.0:1787733824.011855:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787733824.011878:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000499bef53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705695104:12345-0@lo:503: 00000100:00100000:2.0:1787733824.012406:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000499bef53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705695104:12345-0@lo:503: Request processed in 530us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733824.012415:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787733824.012597:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000375bd533 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695104:0@lo:503: 00000040:00080000:0.0:1787733824.012999:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787733824.013142:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008888b2df pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695232:0@lo:502: 00000100:00100000:0.0:1787733824.013285:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733824.013324:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000669f9c4e going to sleep for 11 seconds 00000100:00100000:2.0:1787733824.013593:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705695232 00000100:00100000:2.0:1787733824.013772:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705695232 00000100:00100000:2.0:1787733824.013846:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787733824.013854:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3968088 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705695232:12345-0@lo:502: 00000100:00100000:2.0:1787733824.014248:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3968088 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705695232:12345-0@lo:502: Request processed in 394us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733824.014256:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787733824.014456:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008888b2df pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695232:0@lo:502: 00000040:00080000:0.0:1787733824.015381:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787733824.015451:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787733824.015485:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008888b2df pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695360:0@lo:502: 00000100:00100000:0.0:1787733824.015541:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733824.015572:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000669f9c4e going to sleep for 11 seconds 00000100:00100000:2.0:1787733824.015750:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705695360 00000100:00100000:2.0:1787733824.015757:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705695360 00000100:00100000:2.0:1787733824.015794:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787733824.015802:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5fe96eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705695360:12345-0@lo:502: 00000100:00100000:2.0:1787733824.015963:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5fe96eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705695360:12345-0@lo:502: Request processed in 161us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733824.015970:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787733824.016558:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008888b2df pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695360:0@lo:502: 00000040:00080000:0.0:1787733824.016894:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787733824.016905:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787733824.018775:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787733824.018787:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733824.018790:0:6700:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787733824.018796:0:6700:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891ec73ed000 00000020:00000080:2.0:1787733824.018799:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787733824.018838:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787733824.018842:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733824.018843:0:6700:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787733824.018846:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787733824.019000:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787733824.019139:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787733824.019266:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0000/0x45228d86de4d53c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.019280:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c0000/0x45228d86de4d53c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733824.019319:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787733824.019322:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff891ec73ed000 10000000:01000000:0.0:1787733824.019325:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff891ec73ed000 10000000:01000000:0.0:1787733824.019329:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787733824.019334:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891ec73ed000 from 1 10000000:01000000:0.0:1787733824.019337:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787733824.019370:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.019394:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.019406:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733824.019425:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695488:0@lo:101: 00000100:00100000:0.0:1787733824.019485:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733824.019528:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc10826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.019761:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705695488 00000100:00100000:1.0:1787733824.019769:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705695488 00000100:00100000:1.0:1787733824.019815:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787733824.019825:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705695488:12345-0@lo:101: 00010000:00010000:1.0:1787733824.019838:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733824.019853:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891f020fe400/0x45228d86de4d53db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d53d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.019887:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020fe400/0x45228d86de4d53db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d53d4 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.019898:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891f020fe400/0x45228d86de4d53db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d53d4 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.019907:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020fe400, rc 0) 00000100:00100000:1.0:1787733824.019949:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:6677:x1874574705695488:12345-0@lo:101: Request processed in 125us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.019955:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787733824.020133:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695488:0@lo:101: 00010000:00010000:0.0:1787733824.020147:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.020403:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733824.020509:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695616:0@lo:501: 00000100:00100000:0.0:1787733824.020537:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733824.020677:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc10826c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733824.020900:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705695616 00000100:00100000:3.0:1787733824.020906:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705695616 00000100:00100000:3.0:1787733824.020974:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787733824.020982:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:6677:x1874574705695616:12345-0@lo:501: 00000100:00100000:3.0:1787733824.021394:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:6677:x1874574705695616:12345-0@lo:501: Request processed in 411us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733824.021402:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787733824.021479:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695616:0@lo:501: 00000100:00100000:0.0:1787733824.021510:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695744:0@lo:503: 00000100:00100000:0.0:1787733824.021551:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733824.021842:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc10826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.021911:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705695744 00000100:00100000:1.0:1787733824.021917:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705695744 00000100:00100000:1.0:1787733824.021939:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787733824.021947:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:6677:x1874574705695744:12345-0@lo:503: 00000100:00100000:1.0:1787733824.022130:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:6677:x1874574705695744:12345-0@lo:503: Request processed in 183us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.022137:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787733824.022347:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695744:0@lo:503: 00000040:00080000:0.0:1787733824.022793:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787733824.022865:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695872:0@lo:502: 00000100:00100000:0.0:1787733824.022907:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733824.022938:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc10826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.023364:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705695872 00000100:00100000:1.0:1787733824.023370:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705695872 00000100:00100000:1.0:1787733824.023395:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787733824.023402:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:6677:x1874574705695872:12345-0@lo:502: 00000100:00100000:1.0:1787733824.023584:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:6677:x1874574705695872:12345-0@lo:502: Request processed in 181us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.023591:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787733824.023806:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705695872:0@lo:502: 00000040:00080000:0.0:1787733824.024250:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787733824.024305:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787733824.024341:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787733824.024389:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787733824.024426:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787733824.024491:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787733824.024528:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787733824.024564:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787733824.024744:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787733824.024784:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787733824.024820:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787733824.024881:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787733824.024915:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787733824.024944:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787733824.024988:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787733824.025766:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787733824.025888:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787733824.026194:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787733824.026295:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787733824.026403:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787733824.026527:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787733824.026581:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787733824.026784:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787733824.026843:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787733824.026882:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787733824.026914:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787733824.026957:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787733824.027006:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787733824.027257:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705696000:0@lo:502: 00000100:00100000:0.0:1787733824.027334:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733824.027474:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc10826c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733824.027701:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705696000 00000100:00100000:3.0:1787733824.027710:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705696000 00000100:00100000:3.0:1787733824.027755:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787733824.027764:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:6677:x1874574705696000:12345-0@lo:502: 00000100:00100000:3.0:1787733824.027995:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:6677:x1874574705696000:12345-0@lo:502: Request processed in 231us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733824.028027:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787733824.028262:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705696000:0@lo:502: 00000040:00080000:0.0:1787733824.028352:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787733824.028364:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787733824.029448:0:6701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787733824.029463:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff891ef0324d28) 00000020:00000080:0.0:1787733824.029499:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787733824.029575:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891ec73ed000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787733824.029580:0:6701:0:(tgt_mount.c:187:server_put_mount()) put mount ffff891ec73ed000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787733824.029582:0:6701:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891ec73ed000 3 00010000:00080000:0.0:1787733824.029731:0:6701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891dc5655000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1787733824.039758:0:6701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787733824.040103:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787733824.040145:0:6701:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787733824.040187:0:6701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x45228d86de4d53e9 00000100:00080000:0.0:1787733824.040198:0:6701:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787733824.040204:0:6701:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff891dc5655000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1787733824.040250:0:6701:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891ef6c79180 x1874574705696128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787733824.040271:0:6701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787733824.040459:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874574705696128:0@lo:38: 00000100:00100000:2.0:1787733824.040537:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.040902:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787733824.040913:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705696256:0@lo:400: 00000100:00100000:3.0:1787733824.040943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.040983:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705696128 00000100:00100000:3.0:1787733824.040990:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705696128 00000100:00100000:3.0:1787733824.041201:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705696256 00000100:00100000:3.0:1787733824.041205:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705696256 00000100:00100000:3.0:1787733824.041256:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787733824.041265:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705696256:12345-0@lo:400: 00000100:00100000:3.0:1787733824.041317:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705696256:12345-0@lo:400: Request processed in 52us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733824.041323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787733824.041339:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787733824.041344:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874574705696128:12345-0@lo:38: 00010000:00080000:3.0:1787733824.041365:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:3.0:1787733824.041397:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x45228d86de4d53f0 00000004:00100000:3.0:1787733824.041410:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787733824.041439:0:5833:0:(import.c:65:import_set_state_nolock()) ffff891ec6e58800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787733824.041477:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874574705696128:12345-0@lo:38: Request processed in 131us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733824.041484:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787733824.041523:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff891ef6c79180 x1874574705696128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787733834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733824.041533:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787733824.041541:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00010000:00080000:2.0:1787733824.042828:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff891eeff07b80 x1874574705696256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733824.042845:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705696256:0@lo:400: 00000040:00080000:2.0:1787733824.043567:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00080000:3.0:1787733824.044678:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787733824.044688:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787733824.044693:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891dc5655000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787733824.044707:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874574705696128:0@lo:38: 00000020:01000000:3.0:1787733824.044742:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787733824.044771:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787733824.044937:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.044950:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787733824.045144:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787733824.045146:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787733824.045148:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787733824.045149:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787733824.045150:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787733824.045152:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787733824.045178:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787733824.045180:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787733824.045182:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787733824.045183:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787733824.045185:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787733824.045189:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787733824.045192:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787733824.045193:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787733824.045194:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787733824.045195:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787733824.045197:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787733824.045198:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787733824.045199:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787733824.045200:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787733824.045201:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787733824.045202:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787733824.045203:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787733824.045825:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787733824.045845:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705696384:0@lo:253: 00000100:00100000:3.0:1787733824.045916:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.045961:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff891eed1a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787733824.048277:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705696384 00000100:00100000:0.0:1787733824.048291:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705696384 00000100:00100000:0.0:1787733824.048348:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787733824.048359:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:6677:x1874574705696384:12345-0@lo:253: 20000000:01000000:0.0:1787733824.048390:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787733824.048411:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787733824.090764:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787733824.090781:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787733824.090805:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787733824.090811:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787733824.090834:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.090854:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020c0800/0x45228d86de4d5364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d535d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.090864:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.090905:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020c0800/0x45228d86de4d5364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d535d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.090920:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891f020c0800/0x45228d86de4d5364 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d535d expref: 12 pid: 5827 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733824.090934:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1874574705696512:0@lo:104: 00000100:00100000:0.0:1787733824.091002:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733824.091061:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705696512 00000100:00100000:0.0:1787733824.091067:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc10829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.091071:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705696512 00000100:00100000:1.0:1787733824.091123:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787733824.091146:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:5848:x1874574705696512:12345-0@lo:104: 00010000:00010000:1.0:1787733824.091179:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec0030a00/0x45228d86de4d535d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.091257:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787733824.091264:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:5848:x1874574705696512:12345-0@lo:104: Request processed in 119us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.091271:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787733824.091276:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1874574705696512:0@lo:104: 00010000:00010000:0.0:1787733824.091298:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091318:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787733824.091323:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec0030a00/0x45228d86de4d535d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091330:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030a00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787733824.091334:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec0030a00/0x45228d86de4d535d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091349:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec0030a00/0x45228d86de4d535d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787733824.091355:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec0030a00/0x45228d86de4d535d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733824.091360:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787733824.091397:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec0030a00/0x45228d86de4d535d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091404:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787733824.091439:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec0030a00/0x45228d86de4d535d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091447:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec0030a00/0x45228d86de4d535d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5364 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733824.091459:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705696640:0@lo:103: 00010000:00010000:0.0:1787733824.091465:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733824.091468:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733824.091471:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733824.091494:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733824.091615:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705696640 00000100:00100000:0.0:1787733824.091621:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705696640 00010000:00010000:0.0:1787733824.091651:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020c0800/0x45228d86de4d5364 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d535d expref: 13 pid: 5827 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733824.091678:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787733824.091687:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+13:3313:x1874574705696640:12345-0@lo:103: 00010000:00010000:0.0:1787733824.091698:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733824.091704:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020c0800/0x45228d86de4d5364 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d535d expref: 13 pid: 5827 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091719:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020c0800/0x45228d86de4d5364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d535d expref: 13 pid: 5827 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091732:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020c0800/0x45228d86de4d5364 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d535d expref: 13 pid: 5827 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091745:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091752:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787733824.091763:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001042225s 00010000:00010000:0.0:1787733824.091768:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091774:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091781:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091787:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091792:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787733824.091797:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091803:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091826:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733824.091837:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733824.091847:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.091857:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.091865:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec0030400/0x45228d86de4d53f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733824.091874:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+12:3313:x1874574705696640:12345-0@lo:103: Request processed in 187us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733824.091883:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787733824.091934:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705696640:0@lo:103: 00000100:00100000:2.0:1787733824.130836:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+11:6677:x1874574705696384:12345-0@lo:253: Request processed in 82469us (84908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733824.130853:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787733824.131014:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:6677:1874574705696384:0@lo:253: 10000000:01000000:3.0:1787733824.131138:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787733824.131141:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787733824.131143:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787733824.131145:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787733824.131146:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787733824.131147:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787733824.131148:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787733824.131150:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787733824.131151:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787733824.131187:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787733824.131189:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787733824.131191:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787733824.131215:0:6677:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787733824.141835:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787733824.142004:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787733824.143108:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787733824.143338:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787733824.143518:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787733824.143843:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787733824.148837:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787733824.413459:0:6677:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787733824.413466:0:6677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787733824.413501:0:6677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787733824.413556:0:6677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787733824.413572:0:6677:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787733824.413599:0:6677:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:1.0:1787733824.762765:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787733824.762774:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891ec7b73800 from 21 10000000:01000000:1.0:1787733824.762780:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787733824.762826:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.762838:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.762850:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733824.762891:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705696768:0@lo:101: 00000100:00100000:1.0:1787733824.762962:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733824.763014:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e14180 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.763036:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705696768 00000100:00100000:1.0:1787733824.763043:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705696768 00000100:00100000:1.0:1787733824.763089:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787733824.763100:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:5829:x1874574705696768:12345-0@lo:101: 00010000:00010000:1.0:1787733824.763113:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733824.763126:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891f020ffa00/0x45228d86de4d5405 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d53fe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.763148:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020ffa00/0x45228d86de4d5405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d53fe expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.763186:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891f020ffa00/0x45228d86de4d5405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d53fe expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.763204:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020ffa00, rc 0) 00000100:00100000:1.0:1787733824.763243:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705696768:12345-0@lo:101: Request processed in 145us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.763250:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787733824.763304:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705696768:0@lo:101: 00010000:00010000:1.0:1787733824.763319:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.763328:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733824.763387:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705696896:0@lo:501: 00000100:00100000:1.0:1787733824.763411:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733824.763427:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e14180 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.763441:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705696896 00000100:00100000:1.0:1787733824.763444:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705696896 00000100:00100000:1.0:1787733824.763465:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787733824.763471:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705696896:12345-0@lo:501: 00000100:00100000:1.0:1787733824.763867:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705696896:12345-0@lo:501: Request processed in 395us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.763874:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787733824.763903:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705696896:0@lo:501: 00000100:00100000:1.0:1787733824.763928:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697024:0@lo:503: 00000100:00100000:1.0:1787733824.763963:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733824.763977:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e230c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.763988:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705697024 00000100:00100000:1.0:1787733824.763991:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705697024 00000100:00100000:1.0:1787733824.764010:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787733824.764016:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705697024:12345-0@lo:503: 00000100:00100000:1.0:1787733824.764694:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705697024:12345-0@lo:503: Request processed in 138us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.764704:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787733824.764747:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697024:0@lo:503: 00000100:00100000:1.0:1787733824.774552:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6714:1874574705697152:0@lo:502: 00000100:00100000:1.0:1787733824.774655:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733824.774716:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705697152 00000100:00100000:1.0:1787733824.774717:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e14180 going to sleep for 11 seconds 00000100:00100000:2.0:1787733824.774725:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705697152 00000100:00100000:2.0:1787733824.774774:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787733824.774785:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:6714:x1874574705697152:12345-0@lo:502: 00000100:00100000:2.0:1787733824.775043:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:6714:x1874574705697152:12345-0@lo:502: Request processed in 259us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733824.775052:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787733824.776760:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6714:1874574705697152:0@lo:502: 00000100:00100000:1.0:1787733824.776824:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6714:1874574705697280:0@lo:502: 00000100:00100000:1.0:1787733824.776886:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733824.776909:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705697280 00000100:00100000:0.0:1787733824.776915:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705697280 00000100:00100000:1.0:1787733824.776916:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff891eef58b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787733824.776959:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787733824.776968:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:6714:x1874574705697280:12345-0@lo:502: 00000100:00100000:0.0:1787733824.777192:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:6714:x1874574705697280:12345-0@lo:502: Request processed in 225us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733824.777211:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787733824.777759:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6714:1874574705697280:0@lo:502: 00000040:00080000:1.0:1787733824.777783:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787733824.777858:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787733824.777875:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787733824.777884:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.777895:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733824.777904:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787733824.777907:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff891ec7b73800 from 4 10000000:01000000:1.0:1787733824.777910:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787733824.777935:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.777942:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.777951:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733824.777963:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697408:0@lo:101: 00000100:00100000:1.0:1787733824.777994:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733824.778034:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e14180 going to sleep for 11 seconds 00000100:00100000:2.0:1787733824.779175:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705697408 00000100:00100000:2.0:1787733824.779183:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705697408 00000100:00100000:2.0:1787733824.779228:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787733824.779236:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705697408:12345-0@lo:101: 00010000:00010000:2.0:1787733824.779248:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733824.779262:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13ca200/0x45228d86de4d5413 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d540c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733824.779285:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13ca200/0x45228d86de4d5413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d540c expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733824.779296:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13ca200/0x45228d86de4d5413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d540c expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733824.779306:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca200, rc 0) 00000100:00100000:2.0:1787733824.779355:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705697408:12345-0@lo:101: Request processed in 119us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733824.779362:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787733824.779818:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697408:0@lo:101: 00010000:00010000:3.0:1787733824.779833:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.779844:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733824.779908:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697536:0@lo:256: 00000100:00100000:3.0:1787733824.779943:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733824.779966:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705697536 00000100:00100000:1.0:1787733824.779971:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705697536 00000100:00100000:3.0:1787733824.779975:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.779998:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787733824.780006:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705697536:12345-0@lo:256: 20000000:01000000:1.0:1787733824.780030:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787733824.780046:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787733824.780050:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787733824.780561:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705697536:12345-0@lo:256: Request processed in 554us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.780570:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787733824.783545:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697536:0@lo:256: 10000000:01000000:3.0:1787733824.783617:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787733824.783629:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.783640:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733824.783650:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787733824.783653:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787733824.783656:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787733824.783689:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.783697:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.783706:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733824.783724:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697664:0@lo:101: 00000100:00100000:3.0:1787733824.783781:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.783818:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733824.783838:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705697664 00000100:00100000:3.0:1787733824.783850:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705697664 00000100:00100000:3.0:1787733824.783893:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787733824.783902:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705697664:12345-0@lo:101: 00010000:00010000:3.0:1787733824.783916:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733824.783928:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891f020c1000/0x45228d86de4d5421 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d541a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.783951:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020c1000/0x45228d86de4d5421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d541a expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.783961:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891f020c1000/0x45228d86de4d5421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d541a expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.783970:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1000, rc 0) 00000100:00100000:3.0:1787733824.784005:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705697664:12345-0@lo:101: Request processed in 105us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733824.784012:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787733824.784056:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697664:0@lo:101: 00010000:00010000:3.0:1787733824.784068:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.784077:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733824.784125:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697792:0@lo:501: 00000100:00100000:3.0:1787733824.784150:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.784188:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787733824.784264:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705697792 00000100:00100000:0.0:1787733824.784269:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705697792 00000100:00100000:0.0:1787733824.784300:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787733824.784307:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705697792:12345-0@lo:501: 00000100:00100000:0.0:1787733824.784556:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705697792:12345-0@lo:501: Request processed in 249us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733824.784569:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787733824.784597:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697792:0@lo:501: 00000100:00100000:0.0:1787733824.784621:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697920:0@lo:503: 00000100:00100000:0.0:1787733824.784655:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733824.784679:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787733824.785034:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705697920 00000100:00100000:3.0:1787733824.785039:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705697920 00000100:00100000:3.0:1787733824.785077:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787733824.785084:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705697920:12345-0@lo:503: 00000100:00100000:3.0:1787733824.785350:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705697920:12345-0@lo:503: Request processed in 265us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733824.785357:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787733824.785750:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705697920:0@lo:503: 00000100:00100000:3.0:1787733824.786784:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6717:1874574705698048:0@lo:502: 00000100:00100000:3.0:1787733824.786837:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.786867:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705698048 00000100:00100000:3.0:1787733824.786872:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705698048 00000100:00100000:3.0:1787733824.786908:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787733824.786916:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:6717:x1874574705698048:12345-0@lo:502: 00000100:00100000:3.0:1787733824.787373:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:6717:x1874574705698048:12345-0@lo:502: Request processed in 456us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733824.787380:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787733824.787424:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733824.787440:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6717:1874574705698048:0@lo:502: 00000020:01000000:3.0:1787733824.787463:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787733824.787472:0:6717:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787733824.787478:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733824.787481:0:6717:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787733824.787487:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787733824.787490:0:6717:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:3.0:1787733824.787514:0:6717:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787733824.787517:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787733824.787532:0:6717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff891ef64acd28) 00000020:00000080:3.0:1787733824.787551:0:6717:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787733824.787555:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787733824.787628:0:6717:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787733824.787639:0:6717:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787733824.787646:0:6717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d542f 00010000:00080000:3.0:1787733824.787675:0:6717:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891ef032a800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1787733824.787902:0:6717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787733824.905339:0:6717:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787733824.905364:0:6717:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787733824.910450:0:6717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787733824.910679:0:6717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787733824.910728:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787733824.910784:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787733824.933916:0:6725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787733824.933926:0:6725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787733824.935837:0:6717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787733824.935853:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787733824.935895:0:6717:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787733824.935919:0:6717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45228d86de4d5436 00000100:00080000:3.0:1787733824.935931:0:6717:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787733824.935936:0:6717:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff891ef032a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1787733824.935974:0:6717:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891eeff07100 x1874574705698176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787733824.935996:0:6717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787733824.936068:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787733824.936072:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733824.936074:0:6717:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787733824.936077:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787733824.936081:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733824.936082:0:6717:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787733824.936085:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787733824.936087:0:6717:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787733824.936114:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6717:1874574705698304:0@lo:502: 00000100:00100000:3.0:1787733824.936234:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.936288:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787733824.936317:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705698176:0@lo:8: 00000100:00100000:3.0:1787733824.936349:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.936398:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705698304 00000100:00100000:3.0:1787733824.936410:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705698304 00000100:00100000:3.0:1787733824.936445:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787733824.936453:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:6717:x1874574705698304:12345-0@lo:502: 00000100:00100000:0.0:1787733824.937494:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705698176 00000100:00100000:0.0:1787733824.937503:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705698176 00000100:00100000:0.0:1787733824.937539:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787733824.937545:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874574705698176:12345-0@lo:8: 00010000:00080000:0.0:1787733824.937568:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:0.0:1787733824.937594:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45228d86de4d543d 00002000:00100000:0.0:1787733824.937633:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff891dc5650000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787733824.937637:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787733824.937640:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787733824.937759:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787733824.937889:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787733824.937911:0:6679:0:(import.c:65:import_set_state_nolock()) ffff891dc5652800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787733824.937982:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874574705698176:12345-0@lo:8: Request processed in 436us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733824.937990:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787733824.948381:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:6717:x1874574705698304:12345-0@lo:502: Request processed in 11917us (12136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733824.948398:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787733824.948552:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff891eeff07100 x1874574705698176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787733834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733824.948564:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787733824.948573:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787733824.948581:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787733824.948588:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787733824.948591:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ef032a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787733824.948608:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787733824.948613:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705698176:0@lo:8: 00000100:00100000:3.0:1787733824.950772:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6717:1874574705698304:0@lo:502: 00000020:01000000:3.0:1787733824.950818:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787733824.950827:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733824.950829:0:6717:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787733824.950835:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787733824.950960:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787733824.950989:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787733824.950998:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.951741:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733824.951763:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787733824.951766:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec7b73800 from 1 10000000:01000000:3.0:1787733824.951769:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787733824.951800:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.951808:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.951817:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733824.951836:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705698432:0@lo:101: 00000100:00100000:3.0:1787733824.951895:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.951940:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9780 going to sleep for 11 seconds 00000004:00080000:3.0:1787733824.951959:0:6725:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787733824.952778:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705698432 00000100:00100000:2.0:1787733824.952787:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705698432 00000100:00100000:2.0:1787733824.952841:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787733824.952851:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705698432:12345-0@lo:101: 00010000:00010000:2.0:1787733824.952865:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733824.952880:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13ca600/0x45228d86de4d544b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5444 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733824.952906:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13ca600/0x45228d86de4d544b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5444 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733824.952917:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13ca600/0x45228d86de4d544b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5444 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733824.952927:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca600, rc 0) 00000100:00100000:2.0:1787733824.952977:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705698432:12345-0@lo:101: Request processed in 127us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733824.952984:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000004:00080000:3.0:1787733824.953318:0:6725:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 142942161417ns, next at 0ns, rc = 0 00010000:00010000:2.0:1787733824.955428:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733824.955472:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705698432:0@lo:101: 00010000:00010000:2.0:1787733824.955495:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733824.955507:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733824.955578:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705698560:0@lo:501: 00000100:00100000:2.0:1787733824.955624:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733824.955669:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc4e5e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733824.955685:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705698560 00000100:00100000:2.0:1787733824.955689:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705698560 00000100:00100000:2.0:1787733824.955730:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787733824.955737:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705698560:12345-0@lo:501: 00000100:00100000:2.0:1787733824.955957:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705698560:12345-0@lo:501: Request processed in 219us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733824.955964:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787733824.956000:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705698560:0@lo:501: 00000100:00100000:2.0:1787733824.956024:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705698688:0@lo:503: 00000100:00100000:2.0:1787733824.956057:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733824.956070:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc4e5e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733824.956084:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705698688 00000100:00100000:2.0:1787733824.956088:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705698688 00000100:00100000:2.0:1787733824.956107:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787733824.956113:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705698688:12345-0@lo:503: 00000100:00100000:2.0:1787733824.960396:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705698688:12345-0@lo:503: Request processed in 4273us (4329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733824.960410:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787733824.960794:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705698688:0@lo:503: 00000100:00100000:1.0:1787733824.972410:0:6728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6728:1874574705698816:0@lo:502: 00000100:00100000:1.0:1787733824.972507:0:6728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733824.972550:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705698816 00000100:00100000:1.0:1787733824.972557:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705698816 00000100:00100000:1.0:1787733824.972594:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787733824.972602:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:6728:x1874574705698816:12345-0@lo:502: 00000100:00100000:1.0:1787733824.982248:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:6728:x1874574705698816:12345-0@lo:502: Request processed in 9633us (9729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.982512:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787733824.983296:0:6728:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e230c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.983323:0:6728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6728:1874574705698816:0@lo:502: 00000020:01000000:1.0:1787733824.983357:0:6728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787733824.983368:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787733824.983370:0:6728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787733824.983380:0:6728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891ec7b73800 00000020:00000080:1.0:1787733824.983383:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787733824.983418:0:6728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6728:1874574705698944:0@lo:502: 00000100:00100000:1.0:1787733824.983475:0:6728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733824.983503:0:6728:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e230c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733824.983818:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705698944 00000100:00100000:3.0:1787733824.983827:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705698944 00000100:00100000:3.0:1787733824.983878:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787733824.983888:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:6728:x1874574705698944:12345-0@lo:502: 00000100:00100000:3.0:1787733824.984092:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:6728:x1874574705698944:12345-0@lo:502: Request processed in 206us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733824.984099:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787733824.986231:0:6728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:6728:1874574705698944:0@lo:502: 00000020:01000000:1.0:1787733824.986284:0:6728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787733824.986294:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787733824.986296:0:6728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787733824.986304:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787733824.986605:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787733824.986754:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787733824.986773:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.986784:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733824.986794:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787733824.986797:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff891ef03219b8 from 1 10000000:01000000:3.0:1787733824.986801:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787733824.986835:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.986844:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.986854:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733824.986871:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705699072:0@lo:101: 00000100:00100000:3.0:1787733824.988204:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.988247:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.989139:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705699072 00000100:00100000:1.0:1787733824.989148:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705699072 00000100:00100000:1.0:1787733824.989221:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787733824.989231:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705699072:12345-0@lo:101: 00010000:00010000:1.0:1787733824.989247:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733824.989275:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891f020fe600/0x45228d86de4d5459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5452 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.989304:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020fe600/0x45228d86de4d5459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5452 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.989314:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891f020fe600/0x45228d86de4d5459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5452 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.989322:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020fe600, rc 0) 00000100:00100000:1.0:1787733824.989366:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705699072:12345-0@lo:101: Request processed in 136us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733824.989373:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787733824.989512:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705699072:0@lo:101: 00010000:00010000:3.0:1787733824.989528:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733824.989538:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733824.989601:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705699200:0@lo:501: 00000100:00100000:3.0:1787733824.989815:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733824.989850:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787733824.990397:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705699200 00000100:00100000:1.0:1787733824.990403:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705699200 00000100:00100000:1.0:1787733824.990430:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787733824.990436:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705699200:12345-0@lo:501: 00000100:00100000:1.0:1787733824.991231:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705699200:12345-0@lo:501: Request processed in 792us (1413us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787733824.991240:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787733824.991427:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705699200:0@lo:501: 10000000:01000000:1.0:1787733824.991462:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787733824.991471:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733824.991483:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787733825.020511:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787733825.020789:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705699328:0@lo:13: 00000100:00100000:2.0:1787733825.020866:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787733825.020988:0:6726:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787733825.021029:0:6726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1874574705699456:0@lo:7: 00000100:00100000:3.0:1787733825.021057:0:6726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733825.021076:0:6726:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733825.021099:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705699456 00000100:00100000:3.0:1787733825.021106:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705699456 00000100:00100000:3.0:1787733825.021181:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787733825.021199:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6726:x1874574705699456:12345-0@lo:7: 00000100:00080000:0.0:1787733825.023181:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787733825.028798:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705699328 00000100:00100000:1.0:1787733825.028812:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705699328 00000100:00100000:1.0:1787733825.028876:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787733825.028887:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874574705699328:12345-0@lo:13: 00002000:00000024:1.0:1787733825.029460:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787733825.029595:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874574705699328:12345-0@lo:13: Request processed in 709us (8728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733825.029603:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787733825.029773:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891eeff07100 x1874574705699328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733825.029796:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705699328:0@lo:13: 00002000:00080000:3.0:1787733825.034055:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787733825.034063:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:0.0:1787733825.034355:0:6726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891eeff06300 x1874574705699456/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787733841 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733825.034373:0:6726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1874574705699456:0@lo:7: 00000004:00080000:0.0:1787733825.034387:0:6726:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787733825.034427:0:6726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1874574705699584:0@lo:5: 00000100:00100000:0.0:1787733825.034462:0:6726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733825.034501:0:6726:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc10826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733825.034744:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787733825.034752:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787733825.034945:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705699584 00000100:00100000:1.0:1787733825.034952:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705699584 00000100:00100000:0.0:1787733825.035098:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787733825.035109:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:6726:x1874574705699584:12345-0@lo:5: 00002000:00080000:0.0:1787733825.035136:0:6729:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787733825.035139:0:6729:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787733825.035416:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:6726:x1874574705699584:12345-0@lo:5: Request processed in 308us (952us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787733825.035423:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787733825.035562:0:6726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef6c79c00 x1874574705699584/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787733841 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733825.035575:0:6726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1874574705699584:0@lo:5: 00000004:00080000:1.0:1787733825.035584:0:6726:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787733825.035616:0:6726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1874574705699712:0@lo:700: 00000100:00100000:1.0:1787733825.035656:0:6726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733825.035679:0:6726:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e23d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787733825.035775:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705699712 00000100:00100000:0.0:1787733825.035779:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705699712 00000100:00100000:0.0:1787733825.035812:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787733825.035819:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:6726:x1874574705699712:12345-0@lo:700: 00000100:00100000:0.0:1787733825.035847:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1874574705699840:0@lo:700: 00000100:00100000:0.0:1787733825.035877:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733825.035900:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082180 going to sleep for 11 seconds 00000100:00100000:0.0:1787733825.036508:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705699840 00000100:00100000:0.0:1787733825.036514:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705699840 00000100:00100000:0.0:1787733825.036564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787733825.036571:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1874574705699840:12345-0@lo:700: 00000100:00080000:1.0:1787733825.036708:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733825.037448:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6726:x1874574705699456:12345-0@lo:7: Request processed in 12960us (13091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733825.037462:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 40000000:02000000:1.0:1787733825.080470:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787733825.083994:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1874574705699840:12345-0@lo:700: Request processed in 47413us (48105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733825.084015:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787733825.084359:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef6c78e00 x1874574705699840/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787733841 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733825.084374:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1874574705699840:0@lo:700: 40000000:02000000:3.0:1787733825.084386:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1787733825.243203:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787733825.243223:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787733825.243523:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6726:x1874574705699712:12345-0@lo:700: Request processed in 207698us (207862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733825.243540:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787733825.243789:0:6726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ed2004000 x1874574705699712/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787733841 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733825.243802:0:6726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787733825.243819:0:6726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1874574705699712:0@lo:700: 00000004:02000040:0.0:1787733825.312118:0:6726:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787733825.329078:0:6726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1874574705699968:0@lo:5: 00000100:00100000:0.0:1787733825.329406:0:6726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733825.329465:0:6726:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082300 going to sleep for 11 seconds 00000100:00100000:1.0:1787733825.330603:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705699968 00000100:00100000:1.0:1787733825.330705:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705699968 00000100:00100000:1.0:1787733825.330972:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787733825.330983:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6726:x1874574705699968:12345-0@lo:5: 00002000:00080000:0.0:1787733825.355509:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787733825.355533:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787733825.373551:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6726:x1874574705699968:12345-0@lo:5: Request processed in 42562us (44137us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787733825.373564:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787733825.373674:0:6726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef6c79c00 x1874574705699968/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787733841 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733825.373692:0:6726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1874574705699968:0@lo:5: 00000004:00080000:2.0:1787733825.373704:0:6726:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787733825.985631:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733827.002297:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733828.026402:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733829.050480:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733829.954298:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705700480:0@lo:400: 00000100:00100000:1.0:1787733829.954369:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733829.954432:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787733829.954439:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705700096:0@lo:400: 00000100:00100000:1.0:1787733829.954608:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733829.954648:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705700224:0@lo:400: 00000100:00100000:1.0:1787733829.954684:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733829.954706:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733829.954712:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705700352:0@lo:400: 00000100:00100000:1.0:1787733829.954738:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733829.954780:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705700096 00000100:00100000:1.0:1787733829.954788:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705700096 00000100:00100000:1.0:1787733829.954828:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787733829.954837:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:3310:x1874574705700096:12345-0@lo:400: 00000100:00100000:1.0:1787733829.954899:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:3310:x1874574705700096:12345-0@lo:400: Request processed in 62us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733829.954906:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787733829.955223:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705700224 00000100:00100000:1.0:1787733829.955228:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705700224 00000100:00100000:1.0:1787733829.955254:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705700352 00000100:00100000:1.0:1787733829.955257:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705700352 00000100:00100000:1.0:1787733829.955557:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787733829.955564:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705700224:12345-0@lo:400: 00000100:00100000:1.0:1787733829.955606:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705700224:12345-0@lo:400: Request processed in 43us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733829.955613:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787733829.955625:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787733829.955632:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705700352:12345-0@lo:400: 00000100:00100000:0.0:1787733829.956081:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705700480 00000100:00100000:0.0:1787733829.956087:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705700480 00000100:00100000:0.0:1787733829.956129:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787733829.956136:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705700480:12345-0@lo:400: 00000100:00100000:0.0:1787733829.956188:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705700480:12345-0@lo:400: Request processed in 52us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733829.956194:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787733829.956758:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705700352:12345-0@lo:400: Request processed in 1125us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733829.956764:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787733829.956792:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787733829.956796:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787733829.956825:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ed2005c00 x1874574705700352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733829.956839:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705700352:0@lo:400: 00010000:00080000:1.0:1787733829.956850:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ed2004380 x1874574705700224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733829.956858:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705700224:0@lo:400: 00000100:00100000:1.0:1787733829.956900:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705700096:0@lo:400: 00010000:00080000:1.0:1787733829.956934:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ed2006680 x1874574705700480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733829.956944:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705700480:0@lo:400: 00010000:00010000:0.0:1787733830.079214:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733830.477553:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705700608:0@lo:13: 00000100:00100000:2.0:1787733830.477620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733830.477696:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705700608 00000100:00100000:2.0:1787733830.477703:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705700608 00000100:00100000:2.0:1787733830.477740:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787733830.477748:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874574705700608:12345-0@lo:13: 00002000:00000024:2.0:1787733830.477778:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733830.477815:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874574705700608:12345-0@lo:13: Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733830.477821:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787733830.477856:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef5d5d880 x1874574705700608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733830.477874:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705700608:0@lo:13: 00000001:00080000:0.0:1787733830.538139:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787733831.099429:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787733831.406759:0:7052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787733832.122342:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733833.146471:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733834.186686:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733835.071183:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705700992:0@lo:400: 00000100:00100000:2.0:1787733835.071258:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733835.071320:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787733835.071326:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705701120:0@lo:400: 00000100:00100000:2.0:1787733835.071350:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733835.071392:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705700992 00000100:00100000:2.0:1787733835.071400:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705700992 00000100:00100000:2.0:1787733835.071467:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787733835.071477:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705700992:12345-0@lo:400: 00000100:00100000:2.0:1787733835.071546:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705700992:12345-0@lo:400: Request processed in 70us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733835.071553:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787733835.071582:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705701120 00000100:00100000:2.0:1787733835.071586:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705701120 00000100:00100000:2.0:1787733835.071620:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787733835.071627:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705701120:12345-0@lo:400: 00000100:00100000:2.0:1787733835.071657:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705701120:12345-0@lo:400: Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733835.071662:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787733835.071677:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733835.071681:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787733835.071708:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef5d5e680 x1874574705701120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733835.071719:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787733835.071736:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705701120:0@lo:400: 00010000:00080000:2.0:1787733835.071747:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef5d5dc00 x1874574705700992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733835.071756:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705700992:0@lo:400: 00000100:00100000:3.0:1787733835.071943:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705700736:0@lo:400: 00000100:00100000:3.0:1787733835.071978:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733835.072006:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787733835.072032:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705700864:0@lo:400: 00000100:00100000:3.0:1787733835.072058:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733835.072082:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705700864 00000100:00100000:3.0:1787733835.072086:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705700864 00000100:00100000:3.0:1787733835.072107:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787733835.072113:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705700864:12345-0@lo:400: 00000100:00100000:3.0:1787733835.072144:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705700864:12345-0@lo:400: Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733835.072149:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787733835.072192:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef5d5c380 x1874574705700864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733835.072202:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705700864:0@lo:400: 00000100:00100000:1.0:1787733835.072409:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705700736 00000100:00100000:1.0:1787733835.072414:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705700736 00000100:00100000:1.0:1787733835.072575:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787733835.072584:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:3312:x1874574705700736:12345-0@lo:400: 00000100:00100000:1.0:1787733835.072627:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:3312:x1874574705700736:12345-0@lo:400: Request processed in 45us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733835.072633:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787733835.074249:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705700736:0@lo:400: 00010000:00010000:2.0:1787733835.194260:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733835.585375:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705701248:0@lo:13: 00000100:00100000:1.0:1787733835.585454:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733835.585519:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705701248 00000100:00100000:1.0:1787733835.585525:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705701248 00000100:00100000:1.0:1787733835.585564:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787733835.585573:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705701248:12345-0@lo:13: 00002000:00000024:1.0:1787733835.585614:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733835.585661:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705701248:12345-0@lo:13: Request processed in 89us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733835.585668:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787733835.585712:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef6c7a300 x1874574705701248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733835.585741:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705701248:0@lo:13: 00010000:00010000:3.0:1787733836.231092:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733837.246703:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733838.266630:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733839.290864:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733840.186702:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705701760:0@lo:400: 00000100:00100000:1.0:1787733840.186803:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733840.186880:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733840.186886:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705701376:0@lo:400: 00000100:00100000:1.0:1787733840.186919:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733840.186966:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705701504:0@lo:400: 00000100:00100000:1.0:1787733840.186995:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733840.187017:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787733840.187021:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705701632:0@lo:400: 00000100:00100000:1.0:1787733840.187042:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733840.187083:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705701760 00000100:00100000:1.0:1787733840.187091:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705701760 00000100:00100000:1.0:1787733840.187393:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787733840.187406:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705701760:12345-0@lo:400: 00000100:00100000:1.0:1787733840.187492:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705701760:12345-0@lo:400: Request processed in 88us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733840.187500:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787733840.187568:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ed2005500 x1874574705701760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733840.187585:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705701760:0@lo:400: 00000100:00100000:0.0:1787733840.188643:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705701504 00000100:00100000:0.0:1787733840.188669:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705701504 00000100:00100000:0.0:1787733840.188714:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705701632 00000100:00100000:0.0:1787733840.188718:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705701632 00000100:00100000:0.0:1787733840.188742:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787733840.188751:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705701504:12345-0@lo:400: 00000100:00100000:0.0:1787733840.188830:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705701504:12345-0@lo:400: Request processed in 80us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733840.188838:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787733840.188856:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787733840.188863:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705701632:12345-0@lo:400: 00000100:00100000:0.0:1787733840.188891:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705701632:12345-0@lo:400: Request processed in 29us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733840.188896:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787733840.188920:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705701376 00000100:00100000:0.0:1787733840.188924:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705701376 00000100:00100000:0.0:1787733840.188962:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787733840.188969:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+16:3312:x1874574705701376:12345-0@lo:400: 00000100:00100000:0.0:1787733840.189005:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+16:3312:x1874574705701376:12345-0@lo:400: Request processed in 37us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733840.189153:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705701376:0@lo:400: 00000100:00100000:0.0:1787733840.189856:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787733840.189915:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787733840.189920:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787733840.190145:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ed2005c00 x1874574705701632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733840.190493:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705701632:0@lo:400: 00010000:00080000:1.0:1787733840.190514:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ed2004380 x1874574705701504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733840.190523:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705701504:0@lo:400: 00010000:00010000:2.0:1787733840.315035:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733840.705727:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705701888:0@lo:13: 00000100:00100000:2.0:1787733840.706071:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733840.706240:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705701888 00000100:00100000:2.0:1787733840.706247:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705701888 00000100:00100000:2.0:1787733840.706293:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787733840.706302:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705701888:12345-0@lo:13: 00002000:00000024:2.0:1787733840.706338:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733840.706383:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705701888:12345-0@lo:13: Request processed in 82us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733840.706391:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787733840.706431:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef5d5dc00 x1874574705701888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733840.707732:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705701888:0@lo:13: 00010000:00010000:3.0:1787733841.339311:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733842.364588:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787733842.803763:0:7610:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787733842.803767:0:7610:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787733842.803927:0:7610:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff891ef0329800 00000020:01000004:3.0:1787733842.803945:0:7610:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787733842.803961:0:7610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787733842.803977:0:7610:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff891ef64ab370) 00000020:00000080:3.0:1787733842.804008:0:7610:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787733842.816411:0:7610:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787733842.816648:0:7610:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787733842.839443:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787733842.844873:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787733842.844931:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787733842.844989:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787733842.845013:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787733842.845806:0:7610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787733842.845819:0:7610:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787733842.845830:0:7610:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x45228d86de4d5467 00000020:01000004:0.0:1787733842.845839:0:7610:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787733842.845860:0:7610:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787733842.845869:0:7610:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787733842.845875:0:7610:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787733842.845908:0:7610:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787733842.845913:0:7610:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787733842.867605:0:7610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787733842.867646:0:7610:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.134@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787733842.867651:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787733842.867653:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787733842.867654:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787733842.867656:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787733842.867657:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787733842.867658:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787733842.867660:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787733842.867662:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787733842.867663:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787733842.867665:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787733842.867667:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787733842.867671:0:7610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787733842.867673:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787733842.867675:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787733842.867676:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787733842.867677:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787733842.867678:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787733842.867679:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787733842.867680:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787733842.867681:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787733842.867682:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787733842.867683:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787733842.867684:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787733842.867813:0:7610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787733842.867832:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705702016:0@lo:253: 00000100:00100000:0.0:1787733842.867919:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.868060:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787733842.868486:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705702016 00000100:00100000:3.0:1787733842.868496:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705702016 00000100:00100000:3.0:1787733842.868586:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787733842.868597:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:7610:x1874574705702016:12345-0@lo:253: 20000000:01000000:3.0:1787733842.868648:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787733842.868653:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787733842.868659:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787733842.868662:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787733842.869686:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787733842.869870:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787733842.869897:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787733842.869935:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787733842.869943:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787733842.869974:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787733842.870035:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787733842.870645:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787733842.870667:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:3.0:1787733842.870669:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:3.0:1787733842.870755:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787733842.870764:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787733842.870811:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787733842.870819:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:3.0:1787733842.870844:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787733842.870851:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787733842.870874:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787733842.870936:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787733842.872488:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787733842.872514:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:3.0:1787733842.872517:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:3.0:1787733842.872552:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787733842.872559:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787733842.872588:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787733842.872596:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:3.0:1787733842.872623:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787733842.872631:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787733842.872689:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787733842.872801:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787733842.872819:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787733842.872822:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787733842.872826:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787733842.872839:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787733842.872841:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787733842.872876:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787733842.872878:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787733842.873863:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787733842.873940:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787733842.873995:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787733842.874603:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787733842.874643:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787733842.874777:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787733842.874792:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787733842.874795:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787733842.875590:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787733842.875637:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787733842.875685:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787733842.876046:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787733842.876422:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787733842.876460:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787733842.876473:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787733842.876476:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787733842.876975:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787733842.877536:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787733842.877581:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787733842.877644:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787733842.877658:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787733842.877661:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787733842.878801:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787733842.878877:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787733842.878924:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787733842.879473:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787733842.879523:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787733842.879576:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787733842.879592:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787733842.879595:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787733842.879604:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787733842.879624:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.879643:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec0030800/0x45228d86de4d53b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d53aa expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.879659:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020fe400/0x45228d86de4d53db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d53d4 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.879666:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020ffa00/0x45228d86de4d5405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d53fe expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.879672:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020c1000/0x45228d86de4d5421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d541a expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.879678:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020fe600/0x45228d86de4d5459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5452 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.879686:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.879794:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020fe600/0x45228d86de4d5459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d5452 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.879809:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891f020fe600/0x45228d86de4d5459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d5452 expref: 16 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733842.880039:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705702144:0@lo:104: 00000100:00100000:3.0:1787733842.880490:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787733842.880598:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020c1000/0x45228d86de4d5421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d541a expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.880609:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891f020c1000/0x45228d86de4d5421 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d541a expref: 16 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733842.880620:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff06680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705702272:0@lo:104: 00010000:00010000:3.0:1787733842.880657:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020ffa00/0x45228d86de4d5405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d53fe expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.880665:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891f020ffa00/0x45228d86de4d5405 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d53fe expref: 16 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733842.880674:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705702400:0@lo:104: 00010000:00010000:3.0:1787733842.880711:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020fe400/0x45228d86de4d53db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d53d4 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.880720:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891f020fe400/0x45228d86de4d53db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d53d4 expref: 16 pid: 5827 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733842.880729:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705702528:0@lo:104: 00010000:00010000:3.0:1787733842.880766:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec0030800/0x45228d86de4d53b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d53aa expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.880774:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec0030800/0x45228d86de4d53b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d53aa expref: 16 pid: 5827 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733842.880783:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff06a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705702656:0@lo:104: 00000100:00100000:3.0:1787733842.880802:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec52a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787733842.880923:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787733842.880942:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733842.881016:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733842.881056:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733842.881074:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705702144 00000100:00100000:2.0:1787733842.881080:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705702144 00000100:00100000:2.0:1787733842.881129:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705702272 00000100:00100000:2.0:1787733842.881133:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705702272 00000100:00100000:2.0:1787733842.881144:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705702400 00000100:00100000:2.0:1787733842.881147:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705702400 00000100:00100000:2.0:1787733842.881192:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787733842.881200:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed8e95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+5:5826:x1874574705702144:12345-0@lo:104: 00010000:00010000:2.0:1787733842.881210:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881260:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787733842.881264:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed8e95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+5:5826:x1874574705702144:12345-0@lo:104: Request processed in 66us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733842.881274:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787733842.881321:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787733842.881326:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+4:5826:x1874574705702272:12345-0@lo:104: 00010000:00010000:2.0:1787733842.881334:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881363:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787733842.881366:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+4:5826:x1874574705702272:12345-0@lo:104: Request processed in 42us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733842.881370:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787733842.881379:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787733842.881383:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+3:5826:x1874574705702400:12345-0@lo:104: 00010000:00010000:2.0:1787733842.881388:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881402:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787733842.881404:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+3:5826:x1874574705702400:12345-0@lo:104: Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733842.881407:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787733842.881418:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787733842.881422:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881427:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1400 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:2.0:1787733842.881430:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881442:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787733842.881447:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787733842.881451:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787733842.881473:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881477:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787733842.881490:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881496:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d5452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5459 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881506:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787733842.881508:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881511:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0800 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:2.0:1787733842.881513:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881517:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787733842.881520:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787733842.881527:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787733842.881535:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881539:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787733842.881542:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881546:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020c0800/0x45228d86de4d541a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5421 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881552:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787733842.881554:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881557:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020ff200 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:2.0:1787733842.881559:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881563:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787733842.881566:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787733842.881569:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787733842.881574:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881576:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787733842.881588:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881592:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020ff200/0x45228d86de4d53fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5405 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.881598:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733842.881599:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733842.881600:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733842.881614:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705702784:0@lo:103: 00000100:00100000:2.0:1787733842.881633:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733842.881648:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787733842.881652:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705702912:0@lo:103: 00000100:00100000:2.0:1787733842.881662:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733842.881678:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705703040:0@lo:103: 00000100:00100000:2.0:1787733842.881689:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733842.881834:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705702144:0@lo:104: 00000100:00100000:3.0:1787733842.881840:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff06680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705702272:0@lo:104: 00000100:00100000:3.0:1787733842.881843:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705702400:0@lo:104: 00010000:00010000:0.0:1787733842.881956:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733842.882011:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705702784 00000100:00100000:2.0:1787733842.882015:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705702784 00010000:00010000:2.0:1787733842.882027:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020fe600/0x45228d86de4d5459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5452 expref: 17 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733842.882036:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705702912 00000100:00100000:2.0:1787733842.882038:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705702912 00010000:00010000:2.0:1787733842.882042:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020c1000/0x45228d86de4d5421 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d541a expref: 18 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733842.882048:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705703040 00000100:00100000:2.0:1787733842.882049:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705703040 00010000:00010000:2.0:1787733842.882053:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020ffa00/0x45228d86de4d5405 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d53fe expref: 19 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733842.882068:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787733842.882072:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705702784:12345-0@lo:103: 00010000:00010000:2.0:1787733842.882081:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733842.882086:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020fe600/0x45228d86de4d5459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5452 expref: 19 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.882097:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020fe600/0x45228d86de4d5459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d5452 expref: 19 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.882109:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020fe600/0x45228d86de4d5459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d5452 expref: 19 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.882123:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733842.882225:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787733842.882233:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787733842.882278:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+18:3310:x1874574705702784:12345-0@lo:103: Request processed in 205us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733842.882283:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787733842.882294:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787733842.882300:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+17:3310:x1874574705702912:12345-0@lo:103: 00000100:00100000:3.0:1787733842.882376:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705702784:0@lo:103: 00010000:00010000:2.0:1787733842.882408:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733842.882412:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020c1000/0x45228d86de4d5421 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d541a expref: 17 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.882418:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020c1000/0x45228d86de4d5421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d541a expref: 17 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.882425:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020c1000/0x45228d86de4d5421 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d541a expref: 17 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.882439:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733842.882489:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+16:3310:x1874574705702912:12345-0@lo:103: Request processed in 190us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733842.882493:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787733842.882502:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787733842.882506:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+15:3312:x1874574705703040:12345-0@lo:103: 00010000:00010000:2.0:1787733842.882510:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733842.882513:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020ffa00/0x45228d86de4d5405 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d53fe expref: 15 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.882518:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020ffa00/0x45228d86de4d5405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d53fe expref: 15 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.882525:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020ffa00/0x45228d86de4d5405 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d53fe expref: 15 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.882530:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733842.882552:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+14:3312:x1874574705703040:12345-0@lo:103: Request processed in 46us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733842.882555:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787733842.882646:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705703040:0@lo:103: 00000100:00100000:1.0:1787733842.882818:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733842.882827:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705702528 00000100:00100000:1.0:1787733842.882829:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705702528 00000100:00100000:1.0:1787733842.882843:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705702656 00000100:00100000:1.0:1787733842.882845:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705702656 00000100:00100000:1.0:1787733842.882852:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787733842.882856:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2007480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+4:5826:x1874574705702528:12345-0@lo:104: 00010000:00010000:1.0:1787733842.882862:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.882907:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787733842.882912:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2007480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+4:5826:x1874574705702528:12345-0@lo:104: Request processed in 56us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733842.882918:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787733842.882931:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787733842.882937:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:5826:x1874574705702656:12345-0@lo:104: 00010000:00010000:1.0:1787733842.882944:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d53aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.882979:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787733842.882983:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:5826:x1874574705702656:12345-0@lo:104: Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733842.882990:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787733842.883001:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787733842.883004:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.883009:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:1.0:1787733842.883012:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.883017:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787733842.883021:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733842.883024:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787733842.883039:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.883043:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787733842.883052:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.883056:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec0031800/0x45228d86de4d53d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d53db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.883062:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787733842.883304:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705703168:0@lo:103: 00000100:00100000:2.0:1787733842.883344:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787733842.883390:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733842.883422:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705703168 00000100:00100000:0.0:1787733842.883426:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705703168 00010000:00010000:0.0:1787733842.883440:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020fe400/0x45228d86de4d53db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d53d4 expref: 14 pid: 5827 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733842.883458:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787733842.883462:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+14:3313:x1874574705703168:12345-0@lo:103: 00010000:00010000:0.0:1787733842.883468:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733842.883470:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020fe400/0x45228d86de4d53db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d53d4 expref: 14 pid: 5827 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.883476:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020fe400/0x45228d86de4d53db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d53d4 expref: 14 pid: 5827 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.883484:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733842.883502:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+14:3313:x1874574705703168:12345-0@lo:103: Request processed in 41us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733842.883506:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787733842.883687:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705703168:0@lo:103: 00010000:00010000:1.0:1787733842.883784:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d53aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.883798:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030c00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:1.0:1787733842.883800:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d53aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.883805:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d53aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787733842.883809:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d53aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733842.883812:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787733842.883830:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d53aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.883834:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787733842.883845:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d53aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.883849:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d53aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d53b1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.883859:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733842.883860:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733842.883861:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733842.883999:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020fe400/0x45228d86de4d53db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d53d4 expref: 13 pid: 5827 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733842.884007:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705702528:0@lo:104: 00000100:00100000:1.0:1787733842.884013:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff06a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874574705702656:0@lo:104: 00010000:00010000:1.0:1787733842.884038:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733842.884532:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705702912:0@lo:103: 00000100:00100000:3.0:1787733842.884551:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705703296:0@lo:103: 00000100:00100000:3.0:1787733842.884576:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733842.884767:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705703296 00000100:00100000:1.0:1787733842.884772:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705703296 00010000:00010000:1.0:1787733842.884790:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec0030800/0x45228d86de4d53b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d53aa expref: 13 pid: 5827 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733842.884816:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787733842.884823:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+13:3310:x1874574705703296:12345-0@lo:103: 00010000:00010000:1.0:1787733842.884831:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733842.884835:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec0030800/0x45228d86de4d53b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d53aa expref: 13 pid: 5827 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884845:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec0030800/0x45228d86de4d53b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d53aa expref: 13 pid: 5827 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884857:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec0030800/0x45228d86de4d53b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d53aa expref: 13 pid: 5827 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884869:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884877:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884901:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884907:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884923:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884929:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884935:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1a00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787733842.884940:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884947:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884963:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.884970:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733842.884999:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+12:3310:x1874574705703296:12345-0@lo:103: Request processed in 177us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733842.885003:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787733842.885021:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705703296:0@lo:103: 00010000:00010000:3.0:1787733842.885085:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.885092:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.885098:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020c1a00/0x45228d86de4d546e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787733842.885118:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787733842.941608:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:7610:x1874574705702016:12345-0@lo:253: Request processed in 73005us (73680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733842.941623:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787733842.941798:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705702016:0@lo:253: 10000000:01000000:1.0:1787733842.941817:0:7610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787733842.941820:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787733842.941822:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787733842.941824:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787733842.941825:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787733842.941826:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787733842.941828:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787733842.941836:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787733842.941837:0:7610:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787733842.941839:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787733842.941840:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787733842.941861:0:7610:0:(tgt_mount.c:101:server_register_mount()) register mount ffff891ef0329800 from lustre-OST0001 10000000:01000000:1.0:1787733842.941896:0:7610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787733842.941899:0:7610:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787733842.941907:0:7610:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff891ef03219b8 local copy 10000000:01000000:1.0:1787733842.941910:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787733842.941944:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.941956:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.941965:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733842.941982:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705703424:0@lo:101: 00000100:00100000:1.0:1787733842.942017:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733842.942061:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b04000 going to sleep for 11 seconds 00000100:00100000:2.0:1787733842.942178:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705703424 00000100:00100000:2.0:1787733842.942185:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705703424 00000100:00100000:2.0:1787733842.942231:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787733842.942241:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:7610:x1874574705703424:12345-0@lo:101: 00010000:00010000:2.0:1787733842.942252:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733842.942266:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13cb000/0x45228d86de4d547c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5475 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.942289:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13cb000/0x45228d86de4d547c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5475 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.942300:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13cb000/0x45228d86de4d547c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5475 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.942322:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cb000, rc 0) 00000100:00100000:2.0:1787733842.942351:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:7610:x1874574705703424:12345-0@lo:101: Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733842.942357:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787733842.942560:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705703424:0@lo:101: 00010000:00010000:1.0:1787733842.942571:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.942579:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733842.942665:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705703552:0@lo:501: 00000100:00100000:1.0:1787733842.942756:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733842.942784:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b04000 going to sleep for 11 seconds 00000100:00100000:2.0:1787733842.942841:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705703552 00000100:00100000:2.0:1787733842.942846:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705703552 00000100:00100000:2.0:1787733842.942875:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787733842.942891:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:7610:x1874574705703552:12345-0@lo:501: 00000100:00100000:2.0:1787733842.943319:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:7610:x1874574705703552:12345-0@lo:501: Request processed in 428us (625us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787733842.943326:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787733842.943474:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705703552:0@lo:501: 10000000:01000000:1.0:1787733842.943487:0:7610:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787733842.943514:0:7610:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787733842.943520:0:7610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.943528:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.943535:0:7610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.943593:0:7610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787733842.943617:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff891ef0329800 10000000:01000000:1.0:1787733842.943622:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787733842.943628:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787733842.943630:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787733842.943635:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787733842.943638:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787733842.943659:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.943667:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.943676:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733842.943700:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705703680:0@lo:101: 00000100:00100000:1.0:1787733842.943729:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733842.943766:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b04900 going to sleep for 11 seconds 00000100:00100000:0.0:1787733842.943870:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705703680 00000100:00100000:0.0:1787733842.943889:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705703680 00000100:00100000:0.0:1787733842.943919:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787733842.943927:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:7610:x1874574705703680:12345-0@lo:101: 00010000:00010000:0.0:1787733842.943936:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733842.943946:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0030a00/0x45228d86de4d548a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5483 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.943963:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0030a00/0x45228d86de4d548a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5483 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.943972:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0030a00/0x45228d86de4d548a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5483 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.943979:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030a00, rc 0) 00000100:00100000:0.0:1787733842.944019:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705703680:12345-0@lo:101: Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733842.944025:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787733842.944112:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705703680:0@lo:101: 00010000:00010000:3.0:1787733842.944123:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.944131:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733842.944212:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705703808:0@lo:501: 00000100:00100000:3.0:1787733842.944237:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733842.944265:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec52a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787733842.944412:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705703808 00000100:00100000:0.0:1787733842.944417:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705703808 00000100:00100000:0.0:1787733842.944439:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787733842.944445:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705703808:12345-0@lo:501: 00000100:00100000:0.0:1787733842.944647:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705703808:12345-0@lo:501: Request processed in 200us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733842.944654:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787733842.944784:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705703808:0@lo:501: 00000100:00100000:3.0:1787733842.944810:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705703936:0@lo:503: 00000100:00100000:3.0:1787733842.944850:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733842.944871:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec52a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787733842.944926:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705703936 00000100:00100000:0.0:1787733842.944931:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705703936 00000100:00100000:0.0:1787733842.944952:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787733842.944957:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705703936:12345-0@lo:503: 00000100:00100000:0.0:1787733842.945267:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705703936:12345-0@lo:503: Request processed in 309us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733842.945279:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:2.0:1787733842.945406:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787733842.945413:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.945433:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020fe400 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:2.0:1787733842.945437:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.945444:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787733842.945451:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787733842.945456:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787733842.945476:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.945482:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787733842.945511:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.945519:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020fe400/0x45228d86de4d5475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x45228d86de4d547c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.945532:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733842.945534:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733842.945535:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733842.945575:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787733842.945587:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705704064:0@lo:103: 00000100:00100000:1.0:1787733842.945618:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733842.945790:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705704064 00000100:00100000:2.0:1787733842.945795:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705704064 00000100:00100000:2.0:1787733842.945832:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787733842.945840:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+13:3310:x1874574705704064:12345-0@lo:103: 00010000:00010000:2.0:1787733842.945848:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733842.945867:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13cb000/0x45228d86de4d547c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d5475 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.945887:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733842.945926:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+12:3310:x1874574705704064:12345-0@lo:103: Request processed in 87us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733842.945932:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787733842.946017:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705704064:0@lo:103: 00000100:00100000:3.0:1787733842.946142:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705703936:0@lo:503: 00000040:00080000:3.0:1787733842.946610:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787733842.946667:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704192:0@lo:502: 00000100:00100000:3.0:1787733842.946779:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733842.946857:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec52a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787733842.946905:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705704192 00000100:00100000:1.0:1787733842.946910:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705704192 00000100:00100000:1.0:1787733842.946984:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787733842.946992:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:7610:x1874574705704192:12345-0@lo:502: 00000100:00100000:1.0:1787733842.947211:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:7610:x1874574705704192:12345-0@lo:502: Request processed in 220us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733842.947218:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787733842.947291:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704192:0@lo:502: 00000040:00080000:3.0:1787733842.947534:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787733842.947581:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787733842.947615:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787733842.947664:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787733842.947716:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787733842.947752:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787733842.947776:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704320:0@lo:502: 00000100:00100000:3.0:1787733842.947811:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733842.948271:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec52a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787733842.948380:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705704320 00000100:00100000:0.0:1787733842.948386:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705704320 00000100:00100000:1.0:1787733842.948478:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787733842.948487:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:7610:x1874574705704320:12345-0@lo:502: 00000100:00100000:1.0:1787733842.948635:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:7610:x1874574705704320:12345-0@lo:502: Request processed in 150us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733842.948641:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787733842.948725:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704320:0@lo:502: 00000040:00080000:3.0:1787733842.948814:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787733842.948823:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787733842.949410:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787733842.949417:0:7619:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787733842.949423:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733842.949425:0:7619:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787733842.949429:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787733842.949442:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff891ee56eb370) 00000020:00000080:2.0:1787733842.949462:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787733842.949467:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787733842.949516:0:7619:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891ef0329800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787733842.949523:0:7619:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787733842.949529:0:7619:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x45228d86de4d5498 00010000:00010000:2.0:1787733842.952483:0:7619:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787733842.952817:0:7619:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787733842.955677:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787733842.956045:0:7619:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787733842.960793:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787733842.961411:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787733842.963291:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787733842.963304:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787733842.963311:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787733842.963314:0:7619:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787733842.963318:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787733842.963322:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787733842.963323:0:7619:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787733842.963326:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787733842.963328:0:7619:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787733842.963380:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787733842.963384:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787733842.963385:0:7619:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787733842.963388:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787733842.963549:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787733842.963576:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787733842.963593:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.963606:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733842.963624:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ef0329800 from 1 10000000:01000000:3.0:1787733842.963626:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787733842.963661:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.963668:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733842.963678:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733842.963772:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704448:0@lo:101: 00000100:00100000:3.0:1787733842.963841:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733842.963898:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8528e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787733842.963947:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705704448 00000100:00100000:0.0:1787733842.963955:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705704448 00000100:00100000:0.0:1787733842.964000:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787733842.964009:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:7610:x1874574705704448:12345-0@lo:101: 00010000:00010000:0.0:1787733842.964022:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733842.964032:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0031c00/0x45228d86de4d54a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d549f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.964053:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0031c00/0x45228d86de4d54a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d549f expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.964062:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0031c00/0x45228d86de4d54a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d549f expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.964148:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031c00, rc 0) 00000100:00100000:0.0:1787733842.964214:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705704448:12345-0@lo:101: Request processed in 206us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733842.964221:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787733842.964266:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704448:0@lo:101: 00010000:00010000:0.0:1787733842.964280:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.964288:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733842.964369:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704576:0@lo:501: 00000100:00100000:0.0:1787733842.964392:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.964407:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec50826c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733842.964528:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705704576 00000100:00100000:3.0:1787733842.964533:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705704576 00000100:00100000:3.0:1787733842.964564:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787733842.964570:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705704576:12345-0@lo:501: 00000100:00100000:3.0:1787733842.964846:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705704576:12345-0@lo:501: Request processed in 275us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733842.964853:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787733842.964943:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704576:0@lo:501: 00000100:00100000:0.0:1787733842.964970:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704704:0@lo:503: 00000100:00100000:0.0:1787733842.965005:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.965032:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec50826c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733842.965136:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705704704 00000100:00100000:3.0:1787733842.965140:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705704704 00000100:00100000:3.0:1787733842.965273:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787733842.965281:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705704704:12345-0@lo:503: 00000100:00100000:3.0:1787733842.965564:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705704704:12345-0@lo:503: Request processed in 284us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733842.965580:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787733842.968105:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704704:0@lo:503: 00000040:00080000:0.0:1787733842.968454:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787733842.968541:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704832:0@lo:502: 00000100:00100000:0.0:1787733842.968612:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.968655:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec50826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733842.968820:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705704832 00000100:00100000:1.0:1787733842.968827:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705704832 00000100:00100000:1.0:1787733842.968863:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787733842.968872:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705704832:12345-0@lo:502: 00000100:00100000:1.0:1787733842.969113:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705704832:12345-0@lo:502: Request processed in 242us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733842.969120:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787733842.970197:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704832:0@lo:502: 00000040:00080000:0.0:1787733842.970493:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787733842.970546:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787733842.970575:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704960:0@lo:502: 00000100:00100000:0.0:1787733842.970626:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.970656:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec50826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733842.970740:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705704960 00000100:00100000:1.0:1787733842.970746:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705704960 00000100:00100000:1.0:1787733842.970774:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787733842.970781:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705704960:12345-0@lo:502: 00000100:00100000:1.0:1787733842.970964:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705704960:12345-0@lo:502: Request processed in 182us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733842.970972:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787733842.973117:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705704960:0@lo:502: 00000040:00080000:0.0:1787733842.973308:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787733842.973323:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787733842.975263:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787733842.975278:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733842.975280:0:7623:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787733842.975291:0:7623:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891ef0329800 00000020:00000080:3.0:1787733842.975294:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787733842.975316:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787733842.975320:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733842.975321:0:7623:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787733842.975325:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787733842.975498:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787733842.975523:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787733842.975547:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.975558:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733842.975599:0:7610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787733842.975602:0:7610:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff891ef0329800 10000000:01000000:0.0:1787733842.975606:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff891ef0329800 10000000:01000000:0.0:1787733842.975610:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787733842.975617:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891ef0329800 from 1 10000000:01000000:0.0:1787733842.975619:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787733842.975653:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.975662:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.975673:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733842.975776:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705705088:0@lo:101: 00000100:00100000:0.0:1787733842.975841:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.975892:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082600 going to sleep for 11 seconds 00000100:00100000:1.0:1787733842.975942:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705705088 00000100:00100000:1.0:1787733842.975950:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705705088 00000100:00100000:1.0:1787733842.975996:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787733842.976007:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705705088:12345-0@lo:101: 00010000:00010000:1.0:1787733842.976023:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733842.976038:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891f020fe400/0x45228d86de4d54b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d54ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.976059:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020fe400/0x45228d86de4d54b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d54ad expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.976140:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891f020fe400/0x45228d86de4d54b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d54ad expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733842.976150:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020fe400, rc 0) 00000100:00100000:1.0:1787733842.976224:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:7610:x1874574705705088:12345-0@lo:101: Request processed in 218us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733842.976231:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787733842.976365:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705705088:0@lo:101: 00010000:00010000:0.0:1787733842.976378:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733842.976388:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733842.976475:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705705216:0@lo:501: 00000100:00100000:0.0:1787733842.976500:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.976530:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082600 going to sleep for 11 seconds 00000100:00100000:3.0:1787733842.976572:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705705216 00000100:00100000:3.0:1787733842.976576:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705705216 00000100:00100000:3.0:1787733842.976605:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787733842.976613:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:7610:x1874574705705216:12345-0@lo:501: 00000100:00100000:3.0:1787733842.976961:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:7610:x1874574705705216:12345-0@lo:501: Request processed in 348us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733842.976968:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787733842.977031:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705705216:0@lo:501: 00000100:00100000:0.0:1787733842.977058:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705705344:0@lo:503: 00000100:00100000:0.0:1787733842.977198:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.977215:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082600 going to sleep for 11 seconds 00000100:00100000:1.0:1787733842.977271:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705705344 00000100:00100000:1.0:1787733842.977275:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705705344 00000100:00100000:1.0:1787733842.977304:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787733842.977312:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:7610:x1874574705705344:12345-0@lo:503: 00000100:00100000:1.0:1787733842.977466:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:7610:x1874574705705344:12345-0@lo:503: Request processed in 155us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733842.977473:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787733842.977548:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705705344:0@lo:503: 00000040:00080000:0.0:1787733842.977888:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787733842.977945:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705705472:0@lo:502: 00000100:00100000:0.0:1787733842.977981:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.978018:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082600 going to sleep for 11 seconds 00000100:00100000:3.0:1787733842.978151:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705705472 00000100:00100000:3.0:1787733842.978176:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705705472 00000100:00100000:3.0:1787733842.978207:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787733842.978215:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:7610:x1874574705705472:12345-0@lo:502: 00000100:00100000:3.0:1787733842.978386:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:7610:x1874574705705472:12345-0@lo:502: Request processed in 172us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733842.978393:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787733842.978529:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705705472:0@lo:502: 00000040:00080000:0.0:1787733842.978965:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787733842.979019:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787733842.979052:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787733842.979209:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787733842.979246:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787733842.979294:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787733842.979327:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787733842.979359:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787733842.979407:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787733842.979441:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787733842.979471:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787733842.979532:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787733842.979563:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787733842.979596:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787733842.979640:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787733842.979673:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787733842.979779:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787733842.979842:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787733842.979889:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787733842.979922:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787733842.979964:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787733842.979996:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787733842.980024:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787733842.980058:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787733842.980648:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787733842.980684:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787733842.980809:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787733842.980863:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787733842.980986:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787733842.981035:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787733842.981258:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787733842.981297:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787733842.981330:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787733842.981375:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787733842.981422:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787733842.981478:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787733842.981514:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787733842.981562:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705705600:0@lo:502: 00000100:00100000:0.0:1787733842.981641:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.981793:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082600 going to sleep for 11 seconds 00000100:00100000:3.0:1787733842.981967:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705705600 00000100:00100000:3.0:1787733842.981974:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705705600 00000100:00100000:3.0:1787733842.982056:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787733842.982129:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:7610:x1874574705705600:12345-0@lo:502: 00000100:00100000:3.0:1787733842.982415:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:7610:x1874574705705600:12345-0@lo:502: Request processed in 350us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733842.982424:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787733842.982550:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705705600:0@lo:502: 00000040:00080000:0.0:1787733842.982625:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787733842.982636:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787733842.983420:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787733842.983436:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff891ef0323370) 00000020:00000080:0.0:1787733842.983458:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787733842.983541:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891ef0329800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787733842.983546:0:7624:0:(tgt_mount.c:187:server_put_mount()) put mount ffff891ef0329800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787733842.983549:0:7624:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891ef0329800 3 00010000:00080000:0.0:1787733842.983575:0:7624:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891f0184f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1787733842.989141:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787733842.989434:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787733842.989473:0:7624:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787733842.989488:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x45228d86de4d54c2 00000100:00080000:0.0:1787733842.989500:0:7624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787733842.989506:0:7624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff891f0184f000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1787733842.989542:0:7624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891ef6c78a80 x1874574705705728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787733842.989573:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874574705705728:0@lo:38: 00000100:00100000:0.0:1787733842.989636:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.989864:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705705728 00000100:00100000:0.0:1787733842.989872:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705705728 00000100:00100000:0.0:1787733842.990137:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787733842.990145:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874574705705728:12345-0@lo:38: 00010000:00080000:0.0:1787733842.990191:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1787733842.990231:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x45228d86de4d54c9 00000004:00100000:0.0:1787733842.990248:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787733842.990277:0:5832:0:(import.c:65:import_set_state_nolock()) ffff891dc5655800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787733842.990336:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874574705705728:12345-0@lo:38: Request processed in 190us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733842.990344:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787733842.990428:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef6c78a80 x1874574705705728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787733852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733842.990438:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787733842.990445:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787733842.990452:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787733842.990455:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787733842.990457:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891f0184f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787733842.990463:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874574705705728:0@lo:38: 00000100:00080000:1.0:1787733842.993452:0:7624:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787733842.993675:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705705856:0@lo:400: 00000100:00100000:1.0:1787733842.993757:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733842.993813:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733842.993820:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705705984:0@lo:400: 00000100:00100000:1.0:1787733842.993844:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733842.993973:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705705856 00000100:00100000:3.0:1787733842.993982:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705705856 00000100:00100000:3.0:1787733842.994023:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705705984 00000100:00100000:3.0:1787733842.994027:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705705984 00000100:00100000:3.0:1787733842.994075:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787733842.994085:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705705856:12345-0@lo:400: 00000100:00100000:3.0:1787733842.994139:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705705856:12345-0@lo:400: Request processed in 56us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733842.994147:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787733842.994189:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787733842.994197:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705705984:12345-0@lo:400: 00000100:00100000:3.0:1787733842.994225:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705705984:12345-0@lo:400: Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733842.994232:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787733842.995183:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787733842.995225:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891eeff04000 x1874574705705984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733842.995241:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705705984:0@lo:400: 00010000:00080000:1.0:1787733842.995254:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891eeff05880 x1874574705705856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733842.995263:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705705856:0@lo:400: 00000100:00100000:0.0:1787733842.996060:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705706112:0@lo:400: 00000100:00100000:0.0:1787733842.996224:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787733842.996434:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787733842.996587:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7626:1874574705706240:0@lo:901: 00000100:00100000:0.0:1787733842.996618:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733842.996668:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705706240 00000100:00100000:0.0:1787733842.996676:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705706240 00000100:00100000:2.0:1787733842.996799:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705706112 00000100:00100000:2.0:1787733842.996804:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705706112 00000100:00100000:2.0:1787733842.996851:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787733842.996860:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705706112:12345-0@lo:400: 00000100:00100000:2.0:1787733842.996923:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705706112:12345-0@lo:400: Request processed in 64us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733842.996930:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:2.0:1787733842.996954:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787733842.996977:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787733842.996992:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733842.997010:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787733842.997054:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787733842.997056:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787733842.997058:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787733842.997059:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787733842.997060:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787733842.997061:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787733842.997063:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787733842.997205:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787733842.997208:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787733842.997210:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787733842.997211:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787733842.997215:0:7610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787733842.997218:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787733842.997220:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787733842.997221:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787733842.997221:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787733842.997222:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787733842.997223:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787733842.997225:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787733842.997226:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787733842.997226:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787733842.997227:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787733842.997228:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787733842.997244:0:7610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787733842.997252:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705706368:0@lo:253: 00000100:00100000:2.0:1787733842.997287:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733842.997315:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee033d000 going to sleep for 11 seconds 00000100:00080000:2.0:1787733842.997332:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787733842.997421:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787733842.997429:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1874574705706240:12345-0@lo:901: 00000100:00100000:0.0:1787733842.998421:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1874574705706240:12345-0@lo:901: Request processed in 988us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733842.998432:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787733842.998477:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891eeff04380 x1874574705706112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733842.998491:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705706112:0@lo:400: 00000100:00100000:0.0:1787733842.998522:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705706368 00000100:00100000:0.0:1787733842.998527:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705706368 00000100:00100000:0.0:1787733842.998562:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787733842.998570:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:7610:x1874574705706368:12345-0@lo:253: 20000000:01000000:0.0:1787733842.998595:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787733842.998610:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1787733842.998846:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733842.999204:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082b40 going to sleep for 11 seconds 00010000:00080000:2.0:1787733842.999231:0:7626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891ef6c7b480 x1874574705706240/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787733858 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733842.999253:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7626:1874574705706240:0@lo:901: 20000000:01000000:1.0:1787733843.034016:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787733843.034063:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787733843.034796:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787733843.034802:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787733843.034825:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733843.034843:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec13ca200/0x45228d86de4d5413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d540c expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733843.034851:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733843.034960:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec13ca200/0x45228d86de4d5413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d540c expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733843.034973:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec13ca200/0x45228d86de4d5413 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d540c expref: 14 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733843.034988:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1874574705706496:0@lo:104: 00000100:00100000:0.0:1787733843.035055:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733843.035229:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082600 going to sleep for 11 seconds 00000100:00100000:1.0:1787733843.035284:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705706496 00000100:00100000:1.0:1787733843.035293:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705706496 00000100:00100000:1.0:1787733843.035371:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787733843.035382:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:5848:x1874574705706496:12345-0@lo:104: 00010000:00010000:1.0:1787733843.035394:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733843.035458:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787733843.035464:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:5848:x1874574705706496:12345-0@lo:104: Request processed in 84us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733843.035471:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787733843.035529:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1874574705706496:0@lo:104: 00010000:00010000:0.0:1787733843.035547:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733843.037332:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787733843.037344:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733843.037369:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020ff800 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787733843.037373:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733843.037383:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787733843.037390:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733843.037395:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787733843.037436:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733843.037443:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787733843.037459:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733843.037466:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d540c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5413 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733843.037483:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733843.037485:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733843.037487:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733843.037504:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705706624:0@lo:103: 00000100:00100000:0.0:1787733843.037557:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733843.038430:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705706624 00000100:00100000:2.0:1787733843.038439:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705706624 00010000:00010000:2.0:1787733843.038468:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec13ca200/0x45228d86de4d5413 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d540c expref: 15 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733843.038507:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787733843.038515:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+15:3311:x1874574705706624:12345-0@lo:103: 00010000:00010000:2.0:1787733843.038527:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733843.038533:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec13ca200/0x45228d86de4d5413 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d540c expref: 15 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038543:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec13ca200/0x45228d86de4d5413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d540c expref: 15 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038557:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13ca200/0x45228d86de4d5413 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d540c expref: 15 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038572:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038580:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787733843.038593:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003791174s 00010000:00010000:2.0:1787733843.038597:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038603:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038618:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038624:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038629:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030c00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787733843.038633:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038639:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038653:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038663:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733843.038714:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+14:3311:x1874574705706624:12345-0@lo:103: Request processed in 200us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733843.038721:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787733843.038790:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705706624:0@lo:103: 00010000:00010000:2.0:1787733843.038815:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038822:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733843.038828:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec0030c00/0x45228d86de4d54d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733843.042839:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:7610:x1874574705706368:12345-0@lo:253: Request processed in 44258us (45540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733843.042853:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787733843.042985:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df19622b-ae94-4c8d-b052-574898624480:7610:1874574705706368:0@lo:253: 10000000:01000000:0.0:1787733843.042999:0:7610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787733843.043015:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787733843.043017:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787733843.043018:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787733843.043019:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787733843.043021:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787733843.043022:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787733843.043023:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787733843.043025:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787733843.043026:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787733843.043028:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787733843.043029:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787733843.043042:0:7610:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787733843.048380:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787733843.048576:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787733843.048865:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787733843.049261:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787733843.049470:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787733843.049685:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787733843.051128:0:7610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787733843.235625:0:7610:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787733843.235632:0:7610:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787733843.235664:0:7610:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787733843.235795:0:7610:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787733843.235812:0:7610:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787733843.235841:0:7610:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787733843.390029:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733844.417348:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733845.434532:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733845.818635:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705706752:0@lo:13: 00000100:00100000:3.0:1787733845.818765:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733845.818890:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705706752 00000100:00100000:3.0:1787733845.818899:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705706752 00000100:00100000:3.0:1787733845.818970:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787733845.818981:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705706752:12345-0@lo:13: 00002000:00000024:3.0:1787733845.819028:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733845.819079:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705706752:12345-0@lo:13: Request processed in 99us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733845.819086:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787733845.819108:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787733845.819142:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef5d5df80 x1874574705706752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733845.819190:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705706752:0@lo:13: 00010000:00010000:2.0:1787733846.462844:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733847.489984:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733848.380502:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705706880:0@lo:400: 00000100:00100000:1.0:1787733848.382141:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733848.382251:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705707392:0@lo:400: 00000100:00100000:1.0:1787733848.382311:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733848.382345:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787733848.382353:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705707264:0@lo:400: 00000100:00100000:1.0:1787733848.382383:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733848.382427:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705707008:0@lo:400: 00000100:00100000:1.0:1787733848.382453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733848.382475:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787733848.382481:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705707136:0@lo:400: 00000100:00100000:1.0:1787733848.382502:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733848.382547:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705706880 00000100:00100000:1.0:1787733848.382556:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705706880 00000100:00100000:1.0:1787733848.384965:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787733848.384999:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+13:3313:x1874574705706880:12345-0@lo:400: 00000100:00100000:1.0:1787733848.385139:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+13:3313:x1874574705706880:12345-0@lo:400: Request processed in 149us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733848.385148:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787733848.385211:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705707392 00000100:00100000:1.0:1787733848.385220:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705707392 00000100:00100000:1.0:1787733848.385264:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705707008 00000100:00100000:1.0:1787733848.385267:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705707008 00000100:00100000:1.0:1787733848.385282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705707136 00000100:00100000:1.0:1787733848.385285:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705707136 00000100:00100000:1.0:1787733848.385303:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787733848.385309:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705707392:12345-0@lo:400: 00000100:00100000:1.0:1787733848.385346:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705707392:12345-0@lo:400: Request processed in 37us (3035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733848.385353:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787733848.385364:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787733848.385370:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705707008:12345-0@lo:400: 00000100:00100000:1.0:1787733848.385401:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705707008:12345-0@lo:400: Request processed in 32us (2948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733848.385407:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787733848.385418:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787733848.385424:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705707136:12345-0@lo:400: 00000100:00100000:1.0:1787733848.385449:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705707136:12345-0@lo:400: Request processed in 26us (2946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733848.385455:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787733848.385475:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705707264 00000100:00100000:1.0:1787733848.385479:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705707264 00000100:00100000:1.0:1787733848.385507:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787733848.385519:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705707264:12345-0@lo:400: 00000100:00100000:1.0:1787733848.385556:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705707264:12345-0@lo:400: Request processed in 38us (3172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733848.385563:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787733848.385601:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787733848.385606:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787733848.385644:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ed2004000 x1874574705707136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733848.385661:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705707136:0@lo:400: 00010000:00080000:1.0:1787733848.385675:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ed2004a80 x1874574705707008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733848.385684:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705707008:0@lo:400: 00010000:00080000:1.0:1787733848.385852:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891dc5f88a80 x1874574705707264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733848.385863:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705707264:0@lo:400: 00000100:00100000:1.0:1787733848.385874:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705706880:0@lo:400: 00010000:00080000:1.0:1787733848.385886:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891dc5f88000 x1874574705707392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733848.385894:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705707392:0@lo:400: 00010000:00010000:2.0:1787733848.506350:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787733849.372216:0:7968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787733849.530348:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787733849.914323:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787733849.914334:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891ec73ed000 from 30 10000000:01000000:2.0:1787733849.914341:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787733849.914413:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733849.914427:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733849.914441:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733849.914476:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705707520:0@lo:101: 00000100:00100000:2.0:1787733849.914594:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733849.914664:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef836bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733849.914837:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705707520 00000100:00100000:1.0:1787733849.914848:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705707520 00000100:00100000:1.0:1787733849.914921:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787733849.914933:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705707520:12345-0@lo:101: 00010000:00010000:1.0:1787733849.914957:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733849.914992:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891f020ff600/0x45228d86de4d54de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d54d7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733849.915034:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020ff600/0x45228d86de4d54de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d54d7 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733849.915048:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891f020ff600/0x45228d86de4d54de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d54d7 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733849.915059:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020ff600, rc 0) 00000100:00100000:1.0:1787733849.915116:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705707520:12345-0@lo:101: Request processed in 186us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733849.915124:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787733849.915475:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705707520:0@lo:101: 00010000:00010000:2.0:1787733849.915495:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733849.915507:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733849.915605:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705707648:0@lo:501: 00000100:00100000:2.0:1787733849.915638:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733849.915670:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef836bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733849.915789:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705707648 00000100:00100000:3.0:1787733849.915794:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705707648 00000100:00100000:3.0:1787733849.915830:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787733849.915839:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705707648:12345-0@lo:501: 00000100:00100000:3.0:1787733849.916340:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705707648:12345-0@lo:501: Request processed in 501us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733849.916349:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787733849.916470:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705707648:0@lo:501: 00000100:00100000:0.0:1787733849.916516:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705707776:0@lo:503: 00000100:00100000:0.0:1787733849.916567:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733849.916602:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee033d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787733849.916804:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705707776 00000100:00100000:3.0:1787733849.916809:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705707776 00000100:00100000:3.0:1787733849.916881:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787733849.916891:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705707776:12345-0@lo:503: 00000100:00100000:3.0:1787733849.917260:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705707776:12345-0@lo:503: Request processed in 371us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733849.917268:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787733849.919837:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705707776:0@lo:503: 00000100:00100000:0.0:1787733849.920520:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7991:1874574705707904:0@lo:502: 00000100:00100000:0.0:1787733849.920652:0:7991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733849.920712:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee033d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733849.920862:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705707904 00000100:00100000:2.0:1787733849.920870:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705707904 00000100:00100000:2.0:1787733849.920917:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787733849.920928:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:7991:x1874574705707904:12345-0@lo:502: 00000100:00100000:2.0:1787733849.921390:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:7991:x1874574705707904:12345-0@lo:502: Request processed in 461us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733849.921399:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787733849.921670:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7991:1874574705707904:0@lo:502: 00000100:00100000:0.0:1787733849.921730:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7991:1874574705708032:0@lo:502: 00000100:00100000:0.0:1787733849.921780:0:7991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733849.921813:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee033d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733849.921920:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705708032 00000100:00100000:2.0:1787733849.921926:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705708032 00000100:00100000:2.0:1787733849.921949:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787733849.921956:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:7991:x1874574705708032:12345-0@lo:502: 00000100:00100000:2.0:1787733849.922140:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:7991:x1874574705708032:12345-0@lo:502: Request processed in 183us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733849.922147:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787733849.926488:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7991:1874574705708032:0@lo:502: 00000040:00080000:0.0:1787733849.926555:0:7991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787733849.927119:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787733849.927150:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787733849.927199:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733849.927213:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787733849.927225:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787733849.927238:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787733849.927241:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787733849.927293:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733849.927304:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733849.927315:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733849.927344:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705708160:0@lo:101: 00000100:00100000:2.0:1787733849.927441:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733849.927493:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e14900 going to sleep for 11 seconds 00000100:00100000:2.0:1787733849.927519:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705708160 00000100:00100000:2.0:1787733849.927528:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705708160 00000100:00100000:2.0:1787733849.927860:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787733849.927872:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705708160:12345-0@lo:101: 00010000:00010000:2.0:1787733849.927891:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733849.927907:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13caa00/0x45228d86de4d54ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d54e5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733849.927936:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13caa00/0x45228d86de4d54ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d54e5 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733849.927949:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13caa00/0x45228d86de4d54ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d54e5 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733849.927959:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13caa00, rc 0) 00000100:00100000:2.0:1787733849.928067:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705708160:12345-0@lo:101: Request processed in 197us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733849.928082:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787733849.928135:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705708160:0@lo:101: 00010000:00010000:2.0:1787733849.928153:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733849.928188:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733849.928248:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705708288:0@lo:501: 00000100:00100000:2.0:1787733849.928276:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733849.928297:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e14900 going to sleep for 11 seconds 00000100:00100000:2.0:1787733849.928307:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705708288 00000100:00100000:2.0:1787733849.928311:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705708288 00000100:00100000:2.0:1787733849.928328:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787733849.928334:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705708288:12345-0@lo:501: 00000100:00100000:2.0:1787733849.929470:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705708288:12345-0@lo:501: Request processed in 1131us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733849.929480:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787733849.937537:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705708288:0@lo:501: 00000100:00100000:2.0:1787733849.940205:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705708416:0@lo:503: 00000100:00100000:2.0:1787733849.940330:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733849.940388:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec28d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787733849.940490:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705708416 00000100:00100000:1.0:1787733849.940503:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705708416 00000100:00100000:1.0:1787733849.940589:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787733849.940602:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705708416:12345-0@lo:503: 00000100:00100000:1.0:1787733849.941103:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705708416:12345-0@lo:503: Request processed in 502us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733849.941113:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787733849.941771:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705708416:0@lo:503: 00000100:00100000:2.0:1787733849.943975:0:7993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7993:1874574705708544:0@lo:502: 00000100:00100000:2.0:1787733849.944329:0:7993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733849.944393:0:7993:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec28d39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733849.944675:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705708544 00000100:00100000:1.0:1787733849.944685:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705708544 00000100:00100000:1.0:1787733849.944766:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787733849.944780:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:7993:x1874574705708544:12345-0@lo:502: 00000100:00100000:1.0:1787733849.945913:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:7993:x1874574705708544:12345-0@lo:502: Request processed in 1130us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733849.945925:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787733849.946769:0:7993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7993:1874574705708544:0@lo:502: 00000020:01000000:2.0:1787733849.946817:0:7993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787733849.946828:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733849.946831:0:7993:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787733849.946841:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787733849.946843:0:7993:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787733849.946878:0:7993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7993:1874574705708672:0@lo:502: 00000100:00100000:2.0:1787733849.946937:0:7993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733849.947031:0:7993:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec28d39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733849.947880:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705708672 00000100:00100000:3.0:1787733849.947890:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705708672 00000100:00100000:2.0:1787733849.957796:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787733849.957815:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:7993:x1874574705708672:12345-0@lo:502: 00000100:00100000:2.0:1787733849.958192:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:7993:x1874574705708672:12345-0@lo:502: Request processed in 380us (11254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733849.958202:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787733849.959946:0:7993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7993:1874574705708672:0@lo:502: 00000020:01000000:0.0:1787733849.960029:0:7993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787733849.960045:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787733849.960048:0:7993:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787733849.960053:0:7993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787733849.960224:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787733849.960247:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787733849.960261:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733849.960274:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733849.960287:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787733849.960290:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891ec7b73800 from 30 10000000:01000000:3.0:1787733849.960293:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787733849.960340:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733849.960350:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733849.960361:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733849.960384:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705708800:0@lo:101: 00000100:00100000:3.0:1787733849.960453:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733849.960510:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787733849.960653:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705708800 00000100:00100000:0.0:1787733849.960662:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705708800 00000100:00100000:0.0:1787733849.960721:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787733849.960733:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705708800:12345-0@lo:101: 00010000:00010000:0.0:1787733849.960747:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733849.960773:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0031800/0x45228d86de4d54fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d54f3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733849.960800:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0031800/0x45228d86de4d54fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d54f3 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733849.960811:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0031800/0x45228d86de4d54fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d54f3 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733849.960822:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:0.0:1787733849.960860:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705708800:12345-0@lo:101: Request processed in 129us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733849.960867:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787733849.960955:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705708800:0@lo:101: 00010000:00010000:3.0:1787733849.960969:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733849.960989:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733849.961048:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705708928:0@lo:501: 00000100:00100000:3.0:1787733849.961077:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733849.961104:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787733849.961615:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705708928 00000100:00100000:0.0:1787733849.961622:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705708928 00000100:00100000:0.0:1787733849.961658:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787733849.961666:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705708928:12345-0@lo:501: 00000100:00100000:0.0:1787733849.961978:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705708928:12345-0@lo:501: Request processed in 312us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733849.961993:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787733849.962100:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705708928:0@lo:501: 00000100:00100000:3.0:1787733849.962144:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709056:0@lo:503: 00000100:00100000:3.0:1787733849.962220:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733849.962252:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787733849.962410:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705709056 00000100:00100000:0.0:1787733849.962416:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705709056 00000100:00100000:0.0:1787733849.962447:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787733849.962454:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705709056:12345-0@lo:503: 00000100:00100000:0.0:1787733849.965884:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705709056:12345-0@lo:503: Request processed in 3415us (3649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733849.965903:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787733849.966311:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709056:0@lo:503: 00000100:00100000:1.0:1787733849.966827:0:7995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7995:1874574705709184:0@lo:502: 00000100:00100000:1.0:1787733849.966911:0:7995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733849.966964:0:7995:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787733849.967016:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705709184 00000100:00100000:3.0:1787733849.967024:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705709184 00000100:00100000:3.0:1787733849.967072:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787733849.967083:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+16:7995:x1874574705709184:12345-0@lo:502: 00000100:00100000:3.0:1787733849.967425:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+16:7995:x1874574705709184:12345-0@lo:502: Request processed in 343us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733849.967433:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787733849.967563:0:7995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7995:1874574705709184:0@lo:502: 00000100:00100000:1.0:1787733849.967623:0:7995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7995:1874574705709312:0@lo:502: 00000100:00100000:1.0:1787733849.967658:0:7995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733849.967673:0:7995:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787733849.967790:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705709312 00000100:00100000:3.0:1787733849.967795:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705709312 00000100:00100000:3.0:1787733849.967829:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787733849.967836:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:7995:x1874574705709312:12345-0@lo:502: 00000100:00100000:3.0:1787733849.967974:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:7995:x1874574705709312:12345-0@lo:502: Request processed in 138us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733849.967982:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787733849.968262:0:7995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7995:1874574705709312:0@lo:502: 00000040:00080000:1.0:1787733849.968285:0:7995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787733849.968449:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787733849.968480:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787733849.968492:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733849.968504:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733849.968516:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787733849.968519:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff891ec7b73800 from 5 10000000:01000000:3.0:1787733849.968522:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787733849.968560:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733849.968581:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733849.968591:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733849.968607:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709440:0@lo:101: 00000100:00100000:3.0:1787733849.968644:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733849.968682:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e14900 going to sleep for 11 seconds 00000100:00100000:0.0:1787733849.968805:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705709440 00000100:00100000:0.0:1787733849.968810:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705709440 00000100:00100000:0.0:1787733849.968848:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787733849.968856:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705709440:12345-0@lo:101: 00010000:00010000:0.0:1787733849.968867:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733849.968884:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0030400/0x45228d86de4d5508 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5501 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733849.968910:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0030400/0x45228d86de4d5508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5501 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733849.968923:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0030400/0x45228d86de4d5508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5501 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733849.968933:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030400, rc 0) 00000100:00100000:0.0:1787733849.968979:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705709440:12345-0@lo:101: Request processed in 124us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733849.968986:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787733849.970723:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709440:0@lo:101: 00010000:00010000:1.0:1787733849.970766:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733849.970780:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733849.970861:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709568:0@lo:256: 00000100:00100000:1.0:1787733849.970931:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733849.970993:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787733849.971032:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705709568 00000100:00100000:3.0:1787733849.971041:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705709568 00000100:00100000:3.0:1787733849.971091:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787733849.971101:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705709568:12345-0@lo:256: 20000000:01000000:3.0:1787733849.971122:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787733849.971557:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787733849.971562:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787733849.971688:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705709568:12345-0@lo:256: Request processed in 588us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733849.971703:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787733849.971738:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709568:0@lo:256: 10000000:01000000:0.0:1787733849.971815:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787733849.971823:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733849.971833:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733849.971843:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787733849.971845:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787733849.971848:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787733849.971879:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733849.971886:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733849.971895:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733849.971909:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709696:0@lo:101: 00000100:00100000:0.0:1787733849.971939:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733849.971959:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee547ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787733849.972883:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705709696 00000100:00100000:3.0:1787733849.972893:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705709696 00000100:00100000:3.0:1787733849.972938:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787733849.972947:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705709696:12345-0@lo:101: 00010000:00010000:3.0:1787733849.972960:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733849.972977:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891f020c0800/0x45228d86de4d5516 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d550f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733849.973017:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020c0800/0x45228d86de4d5516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d550f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733849.973028:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891f020c0800/0x45228d86de4d5516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d550f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733849.973039:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c0800, rc 0) 00000100:00100000:3.0:1787733849.973102:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705709696:12345-0@lo:101: Request processed in 155us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733849.973109:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787733849.973230:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709696:0@lo:101: 00010000:00010000:0.0:1787733849.973248:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733849.973259:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733849.973342:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709824:0@lo:501: 00000100:00100000:0.0:1787733849.973374:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733849.973399:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee547ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787733849.973455:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705709824 00000100:00100000:3.0:1787733849.973459:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705709824 00000100:00100000:3.0:1787733849.973489:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787733849.973497:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705709824:12345-0@lo:501: 00000100:00100000:3.0:1787733849.973823:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705709824:12345-0@lo:501: Request processed in 325us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733849.973830:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787733849.974006:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709824:0@lo:501: 00000100:00100000:1.0:1787733849.974038:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709952:0@lo:503: 00000100:00100000:1.0:1787733849.974079:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733849.974110:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787733849.974239:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705709952 00000100:00100000:3.0:1787733849.974244:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705709952 00000100:00100000:3.0:1787733849.974310:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787733849.974317:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705709952:12345-0@lo:503: 00000100:00100000:3.0:1787733849.974671:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705709952:12345-0@lo:503: Request processed in 354us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733849.974678:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787733849.974746:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705709952:0@lo:503: 00000100:00100000:2.0:1787733849.976901:0:7996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7996:1874574705710080:0@lo:502: 00000100:00100000:2.0:1787733849.976990:0:7996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733849.992865:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705710080 00000100:00100000:1.0:1787733849.992881:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705710080 00000100:00100000:2.0:1787733849.992911:0:7996:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec28d33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733849.992971:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787733849.992984:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:7996:x1874574705710080:12345-0@lo:502: 00000100:00100000:1.0:1787733849.993970:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:7996:x1874574705710080:12345-0@lo:502: Request processed in 986us (16977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733849.993982:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787733849.994112:0:7996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7996:1874574705710080:0@lo:502: 00000020:01000000:2.0:1787733849.994183:0:7996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787733849.994192:0:7996:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787733849.994202:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733849.994204:0:7996:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787733849.994214:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787733849.994218:0:7996:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:2.0:1787733849.994249:0:7996:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787733849.994253:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787733849.994301:0:7996:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff891ee57b8000) 00000020:00000080:2.0:1787733849.994327:0:7996:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787733849.994343:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787733849.994445:0:7996:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787733849.994452:0:7996:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787733849.994460:0:7996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d5524 00010000:00080000:2.0:1787733849.994501:0:7996:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891efe96f800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1787733849.994802:0:7996:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787733849.998029:0:7996:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787733849.998052:0:7996:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787733849.998647:0:7996:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787733849.998885:0:7996:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787733849.998943:0:7996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787733849.999010:0:7996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787733849.999675:0:7998:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733849.999682:0:7998:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787733850.000772:0:7996:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787733850.000789:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787733850.000837:0:7996:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787733850.000870:0:7996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45228d86de4d552b 00000100:00080000:1.0:1787733850.000885:0:7996:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787733850.000893:0:7996:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff891efe96f800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787733850.000944:0:7996:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891dc5f8a680 x1874574705710208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787733850.001009:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705710208:0@lo:8: 00000100:00100000:0.0:1787733850.001108:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787733850.001255:0:7996:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787733850.001315:0:7996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787733850.001320:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787733850.001322:0:7996:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787733850.001326:0:7996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787733850.001330:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787733850.001331:0:7996:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787733850.001334:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787733850.001337:0:7996:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787733850.001366:0:7996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f89180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7996:1874574705710336:0@lo:502: 00000100:00100000:1.0:1787733850.001424:0:7996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733850.001459:0:7996:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787733850.001592:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705710336 00000100:00100000:2.0:1787733850.001601:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705710336 00000100:00100000:0.0:1787733850.001602:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705710208 00000100:00100000:0.0:1787733850.001605:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705710208 00000100:00100000:2.0:1787733850.001649:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787733850.001661:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+18:7996:x1874574705710336:12345-0@lo:502: 00000100:00100000:0.0:1787733850.001716:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787733850.001721:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874574705710208:12345-0@lo:8: 00010000:00080000:0.0:1787733850.001746:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:0.0:1787733850.001791:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45228d86de4d5532 00002000:00100000:0.0:1787733850.001809:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff891ec6c87000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787733850.001814:0:6681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787733850.001818:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787733850.001965:0:6681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787733850.001977:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+18:7996:x1874574705710336:12345-0@lo:502: Request processed in 317us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733850.001986:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00002000:00080000:0.0:1787733850.002137:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787733850.002199:0:6681:0:(import.c:65:import_set_state_nolock()) ffff891ec6c80800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787733850.002428:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874574705710208:12345-0@lo:8: Request processed in 704us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733850.002435:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787733850.002523:0:7996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f89180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:7996:1874574705710336:0@lo:502: 00000020:01000000:1.0:1787733850.002568:0:7996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787733850.002575:0:7996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787733850.002577:0:7996:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787733850.002582:0:7996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1787733850.002945:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787733850.003032:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874574705710592:0@lo:400: 00000100:00100000:3.0:1787733850.003081:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733850.003141:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705710464:0@lo:400: 00000100:00100000:3.0:1787733850.003183:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787733850.003281:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787733850.003314:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787733850.003326:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733850.003346:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733850.003359:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787733850.003362:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff891ef03219b8 from 1 10000000:01000000:0.0:1787733850.003365:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787733850.003397:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733850.003405:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733850.003415:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733850.003429:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705710976:0@lo:101: 00000100:00100000:0.0:1787733850.003464:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733850.003494:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee547e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787733850.003516:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705710720:0@lo:400: 00000100:00100000:0.0:1787733850.003545:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733850.003568:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787733850.003573:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705710848:0@lo:400: 00000100:00100000:0.0:1787733850.003612:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705710976 00000100:00100000:0.0:1787733850.003620:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705710976 00000100:00100000:0.0:1787733850.003660:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787733850.003669:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705710976:12345-0@lo:101: 00010000:00010000:0.0:1787733850.003681:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733850.003718:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6659000/0x45228d86de4d5540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5539 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733850.003746:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6659000/0x45228d86de4d5540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5539 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733850.003770:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6659000/0x45228d86de4d5540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5539 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733850.003780:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659000, rc 0) 00000100:00100000:0.0:1787733850.003817:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705710976:12345-0@lo:101: Request processed in 150us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733850.003824:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787733850.003856:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705710720 00000100:00100000:0.0:1787733850.003860:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705710720 00000100:00100000:0.0:1787733850.003901:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787733850.003908:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705710720:12345-0@lo:400: 00000100:00100000:0.0:1787733850.003946:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705710720:12345-0@lo:400: Request processed in 39us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733850.003952:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787733850.003972:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787733850.004002:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705710976:0@lo:101: 00010000:00010000:0.0:1787733850.004017:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733850.004027:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733850.004079:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705711104:0@lo:501: 00000100:00100000:0.0:1787733850.004114:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733850.004139:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee547e000 going to sleep for 11 seconds 00010000:00080000:0.0:1787733850.004198:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891dc5f8a680 x1874574705710208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787733860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733850.004210:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787733850.004219:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787733850.004229:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787733850.004235:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787733850.004239:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891efe96f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787733850.004251:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787733850.004258:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705710208:0@lo:8: 00000100:00100000:3.0:1787733850.005398:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733850.005467:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705710592 00000100:00100000:1.0:1787733850.005475:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705710592 00000100:00100000:1.0:1787733850.005526:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705710464 00000100:00100000:1.0:1787733850.005530:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705710464 00000100:00100000:1.0:1787733850.005548:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787733850.005555:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874574705710592:12345-0@lo:400: 00000100:00100000:1.0:1787733850.005631:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874574705710592:12345-0@lo:400: Request processed in 76us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733850.005639:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787733850.005656:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787733850.005663:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705710464:12345-0@lo:400: 00000100:00100000:1.0:1787733850.005692:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705710464:12345-0@lo:400: Request processed in 30us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733850.005697:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787733850.005719:0:7998:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787733850.005938:0:7998:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 167994780872ns, next at 0ns, rc = 0 00010000:00080000:3.0:1787733850.006082:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c79c00 x1874574705710720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733850.006098:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705710720:0@lo:400: 00010000:00080000:3.0:1787733850.006133:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c7aa00 x1874574705710464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733850.006142:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705710464:0@lo:400: 00010000:00080000:3.0:1787733850.006190:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c7a300 x1874574705710592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733850.006199:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874574705710592:0@lo:400: 00000100:00100000:2.0:1787733850.006248:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705711104 00000100:00100000:2.0:1787733850.006254:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705711104 00000100:00100000:2.0:1787733850.006305:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787733850.006314:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705711104:12345-0@lo:501: 00000100:00100000:0.0:1787733850.006458:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705710848 00000100:00100000:0.0:1787733850.006464:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705710848 00000100:00100000:2.0:1787733850.008367:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705711104:12345-0@lo:501: Request processed in 252us (2451us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787733850.008390:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787733850.009943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787733850.009968:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705710848:12345-0@lo:400: 00000100:00100000:1.0:1787733850.010103:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705710848:12345-0@lo:400: Request processed in 146us (4710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733850.010111:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787733850.010194:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c78e00 x1874574705710848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733850.010391:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705710848:0@lo:400: 00000100:00100000:3.0:1787733850.012001:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705711104:0@lo:501: 10000000:01000000:3.0:1787733850.012060:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787733850.012074:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733850.012098:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787733850.012469:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787733850.057497:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705711232:0@lo:13: 00000100:00100000:0.0:1787733850.057590:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733850.057665:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705711232 00000100:00100000:0.0:1787733850.057675:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705711232 00000100:00100000:0.0:1787733850.057748:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787733850.057922:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705711232:12345-0@lo:13: 00002000:00000024:0.0:1787733850.057966:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787733850.058021:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705711232:12345-0@lo:13: Request processed in 103us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733850.058030:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787733850.058057:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787733850.058093:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c7b800 x1874574705711232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733850.058130:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705711232:0@lo:13: 00000004:00080000:0.0:1787733850.058184:0:8000:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787733850.058208:0:8000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1874574705711360:0@lo:7: 00000100:00100000:0.0:1787733850.058238:0:8000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733850.058264:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705711360 00000100:00100000:0.0:1787733850.058268:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705711360 00000100:00100000:0.0:1787733850.058297:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787733850.058305:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8000:x1874574705711360:12345-0@lo:7: 00000100:00100000:3.0:1787733850.064007:0:8000:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee547e780 going to sleep for 11 seconds 00002000:00080000:0.0:1787733850.064637:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787733850.064645:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787733850.064832:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8000:x1874574705711360:12345-0@lo:7: Request processed in 6519us (6585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733850.066418:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787733850.070458:0:8000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c7b800 x1874574705711360/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787733866 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733850.070484:0:8000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1874574705711360:0@lo:7: 00000004:00080000:3.0:1787733850.070507:0:8000:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787733850.072101:0:8000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1874574705711488:0@lo:5: 00000100:00100000:3.0:1787733850.072214:0:8000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733850.072283:0:8000:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082480 going to sleep for 11 seconds 00000100:00100000:1.0:1787733850.075584:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705711488 00000100:00100000:1.0:1787733850.075602:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705711488 00000100:00100000:1.0:1787733850.075679:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787733850.075692:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8000:x1874574705711488:12345-0@lo:5: 00002000:00080000:1.0:1787733850.075729:0:6682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787733850.075733:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787733850.076728:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8000:x1874574705711488:12345-0@lo:5: Request processed in 1029us (4507us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787733850.076743:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787733850.076834:0:8000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff05c00 x1874574705711488/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787733866 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733850.076857:0:8000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1874574705711488:0@lo:5: 00000004:00080000:1.0:1787733850.076870:0:8000:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787733850.077180:0:8000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f89180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1874574705711616:0@lo:700: 00000100:00100000:1.0:1787733850.077218:0:8000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733850.077257:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705711616 00000100:00100000:1.0:1787733850.077263:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705711616 00000100:00100000:1.0:1787733850.077301:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787733850.077309:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8000:x1874574705711616:12345-0@lo:700: 00000100:00100000:1.0:1787733850.077339:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1874574705711744:0@lo:700: 00000100:00100000:1.0:1787733850.077368:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733850.077389:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733850.077408:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705711744 00000100:00100000:1.0:1787733850.077427:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705711744 00000100:00100000:1.0:1787733850.078672:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787733850.078690:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1874574705711744:12345-0@lo:700: 00000100:00100000:2.0:1787733850.079295:0:8000:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2240 going to sleep for 11 seconds 00000004:00080000:3.0:1787733850.103507:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1787733850.128609:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787733850.134976:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1874574705711744:12345-0@lo:700: Request processed in 56284us (57597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733850.135012:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787733850.135150:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891dc5f8b800 x1874574705711744/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787733866 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733850.135193:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1874574705711744:0@lo:700: 40000000:02000000:1.0:1787733850.135212:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:0.0:1787733850.184927:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787733850.184951:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1787733850.185058:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8000:x1874574705711616:12345-0@lo:700: Request processed in 107742us (107832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733850.185074:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787733850.185105:0:8000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891dc5f89180 x1874574705711616/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787733866 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733850.185126:0:8000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f89180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1874574705711616:0@lo:700: 00000004:02000040:0.0:1787733850.207083:0:8000:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787733850.217681:0:8000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1874574705711872:0@lo:5: 00000100:00100000:3.0:1787733850.217776:0:8000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733850.217882:0:8000:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082480 going to sleep for 11 seconds 00000100:00100000:0.0:1787733850.218628:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705711872 00000100:00100000:0.0:1787733850.218638:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705711872 00000100:00100000:0.0:1787733850.218719:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787733850.218731:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8000:x1874574705711872:12345-0@lo:5: 00002000:00080000:3.0:1787733850.228864:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787733850.228893:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787733850.239803:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8000:x1874574705711872:12345-0@lo:5: Request processed in 21062us (22015us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787733850.239819:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787733850.240054:0:8000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff07100 x1874574705711872/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787733866 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733850.240070:0:8000:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787733850.240090:0:8000:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff891eeff07100 x1874574705711872/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787733866 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733850.240104:0:8000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff07100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8000:1874574705711872:0@lo:5: 00000004:00080000:3.0:1787733850.240131:0:8000:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1787733850.559432:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733850.938378:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705712000:0@lo:13: 00000100:00100000:0.0:1787733850.938451:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733850.938680:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705712000 00000100:00100000:3.0:1787733850.938688:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705712000 00000100:00100000:3.0:1787733850.938755:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787733850.938766:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705712000:12345-0@lo:13: 00002000:00000024:3.0:1787733850.938802:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733850.939077:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705712000:12345-0@lo:13: Request processed in 311us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733850.939087:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787733850.939145:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef5d5f800 x1874574705712000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733850.939231:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705712000:0@lo:13: 00010000:00010000:2.0:1787733851.578307:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733852.602688:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733853.626331:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787733854.301866:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787733854.650422:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733854.821808:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733854.822333:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689960064 00000100:00100000:3.0:1787733854.822345:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689960064 00000100:00100000:3.0:1787733854.822388:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:3.0:1787733854.822397:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1874574689960064:12345-192.168.201.34@tcp:250: 00010000:00080000:3.0:1787733854.822427:0:5825:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b6bb7a2f-8e14-4d78-9208-bab3541e755f@192.168.201.34@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:3.0:1787733854.822453:0:5825:0:(genops.c:1385:class_connect()) connect: client b6bb7a2f-8e14-4d78-9208-bab3541e755f, cookie 0x45228d86de4d5547 00000100:00080000:3.0:1787733854.822605:0:5825:0:(import.c:65:import_set_state_nolock()) ffff891ec6d35800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787733854.822685:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+5:2353:x1874574689960064:12345-192.168.201.34@tcp:250: Request processed in 287us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733854.822693:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:0.0:1787733854.828480:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733854.828708:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689960192 00000100:00100000:3.0:1787733854.828720:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689960192 00000100:00100000:3.0:1787733854.828777:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:3.0:1787733854.828787:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+5:5579:x1874574689960192:12345-192.168.201.34@tcp:101: 00010000:00010000:3.0:1787733854.828805:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733854.828824:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891efe7ec000/0x45228d86de4d554e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df192d7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733854.828867:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891efe7ec000/0x45228d86de4d554e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df192d7 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733854.828879:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891efe7ec000/0x45228d86de4d554e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df192d7 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733854.828888:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec000, rc 0) 00000100:00100000:3.0:1787733854.828945:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+6:5579:x1874574689960192:12345-192.168.201.34@tcp:101: Request processed in 159us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733854.828952:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:3.0:1787733854.835507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733854.835589:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689960320 00000100:00100000:2.0:1787733854.835600:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689960320 00000100:00100000:2.0:1787733854.835656:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:2.0:1787733854.835667:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+6:5579:x1874574689960320:12345-192.168.201.34@tcp:501: 00000100:00100000:2.0:1787733854.836030:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+6:5579:x1874574689960320:12345-192.168.201.34@tcp:501: Request processed in 364us (543us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787733854.836039:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:2.0:1787733854.841554:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733854.843178:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689960448 00000100:00100000:0.0:1787733854.845430:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689960448 00000100:00100000:0.0:1787733854.845499:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:0.0:1787733854.845510:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+6:5579:x1874574689960448:12345-192.168.201.34@tcp:101: 00010000:00010000:0.0:1787733854.845526:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733854.845541:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df192de expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733854.845567:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df192de expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733854.845577:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df192de expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733854.845586:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658a00, rc 0) 00000100:00100000:0.0:1787733854.845649:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+7:5579:x1874574689960448:12345-192.168.201.34@tcp:101: Request processed in 140us (4108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733854.845656:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:1.0:1787733854.847794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733854.847871:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689960576 00000100:00100000:3.0:1787733854.847879:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689960576 00000100:00100000:3.0:1787733854.847918:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:3.0:1787733854.847928:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+7:5579:x1874574689960576:12345-192.168.201.34@tcp:501: 00000100:00100000:3.0:1787733854.848208:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:5579:x1874574689960576:12345-192.168.201.34@tcp:501: Request processed in 280us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733854.848216:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:0.0:1787733854.854629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733854.854785:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689960704 00000100:00100000:2.0:1787733854.854795:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689960704 00000100:00100000:2.0:1787733854.854848:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:2.0:1787733854.854859:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:5579:x1874574689960704:12345-192.168.201.34@tcp:503: 00000100:00100000:2.0:1787733854.855213:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:5579:x1874574689960704:12345-192.168.201.34@tcp:503: Request processed in 354us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733854.855222:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:1.0:1787733854.864729:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733854.864844:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689960832 00000100:00100000:3.0:1787733854.864854:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689960832 00000100:00100000:3.0:1787733854.864908:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:3.0:1787733854.864918:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:5598:x1874574689960832:12345-192.168.201.34@tcp:502: 00000100:00100000:3.0:1787733854.865398:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:5598:x1874574689960832:12345-192.168.201.34@tcp:502: Request processed in 480us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733854.865408:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:0.0:1787733854.904771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733854.904859:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689960960 00000100:00100000:3.0:1787733854.904870:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689960960 00000100:00100000:3.0:1787733854.904927:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:3.0:1787733854.904938:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:5598:x1874574689960960:12345-192.168.201.34@tcp:502: 00000100:00100000:3.0:1787733854.905358:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:5598:x1874574689960960:12345-192.168.201.34@tcp:502: Request processed in 420us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733854.905368:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:1.0:1787733854.914572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733854.914757:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689961088 00000100:00100000:3.0:1787733854.914768:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689961088 00000100:00100000:3.0:1787733854.914829:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:3.0:1787733854.914840:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:5579:x1874574689961088:12345-192.168.201.34@tcp:101: 00010000:00010000:3.0:1787733854.914858:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733854.914875:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891efe7ed400/0x45228d86de4d555c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df19308 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733854.914902:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891efe7ed400/0x45228d86de4d555c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19308 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733854.914914:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891efe7ed400/0x45228d86de4d555c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19308 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733854.914924:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ed400, rc 0) 00000100:00100000:3.0:1787733854.914983:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5579:x1874574689961088:12345-192.168.201.34@tcp:101: Request processed in 144us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733854.914991:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:1.0:1787733854.920424:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733854.920735:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689961216 00000100:00100000:3.0:1787733854.920745:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689961216 00000100:00100000:3.0:1787733854.920802:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:3.0:1787733854.920823:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5579:x1874574689961216:12345-192.168.201.34@tcp:256: 20000000:01000000:3.0:1787733854.920850:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787733854.920869:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787733854.920874:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787733854.920877:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787733854.920880:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787733854.928183:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5579:x1874574689961216:12345-192.168.201.34@tcp:256: Request processed in 7324us (7733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733854.928263:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:1.0:1787733854.934857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733854.934959:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689961344 00000100:00100000:0.0:1787733854.934970:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689961344 00000100:00100000:0.0:1787733854.935025:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1787733854.935037:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5579:x1874574689961344:12345-192.168.201.34@tcp:101: 00010000:00010000:0.0:1787733854.935054:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733854.935072:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6658400/0x45228d86de4d5563 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df1930f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733854.935096:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6658400/0x45228d86de4d5563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1930f expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733854.935105:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6658400/0x45228d86de4d5563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1930f expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733854.935112:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658400, rc 0) 00000100:00100000:0.0:1787733854.935177:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5579:x1874574689961344:12345-192.168.201.34@tcp:101: Request processed in 143us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733854.935182:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:1.0:1787733854.937570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733854.937694:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689961472 00000100:00100000:3.0:1787733854.937703:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689961472 00000100:00100000:3.0:1787733854.937749:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:3.0:1787733854.937759:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5579:x1874574689961472:12345-192.168.201.34@tcp:501: 00000100:00100000:3.0:1787733854.938050:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5579:x1874574689961472:12345-192.168.201.34@tcp:501: Request processed in 292us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733854.938059:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:3.0:1787733854.940775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733854.940910:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689961600 00000100:00100000:1.0:1787733854.940919:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689961600 00000100:00100000:1.0:1787733854.940974:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:1.0:1787733854.940984:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5579:x1874574689961600:12345-192.168.201.34@tcp:503: 00000100:00100000:1.0:1787733854.941380:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5579:x1874574689961600:12345-192.168.201.34@tcp:503: Request processed in 396us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733854.941389:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:1.0:1787733854.950619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733854.951002:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689961728 00000100:00100000:3.0:1787733854.951014:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689961728 00000100:00100000:3.0:1787733854.951067:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:3.0:1787733854.951078:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5600:x1874574689961728:12345-192.168.201.34@tcp:502: 00000100:00100000:3.0:1787733854.951923:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5600:x1874574689961728:12345-192.168.201.34@tcp:502: Request processed in 843us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733854.951933:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:3.0:1787733854.954181:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733854.954328:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689961856 00000100:00100000:2.0:1787733854.954348:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689961856 00000100:00100000:2.0:1787733854.954395:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:2.0:1787733854.954406:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5600:x1874574689961856:12345-192.168.201.34@tcp:502: 00000100:00100000:2.0:1787733854.954638:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5600:x1874574689961856:12345-192.168.201.34@tcp:502: Request processed in 233us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733854.954647:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:0.0:1787733854.957443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733854.957581:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689961984 00000100:00100000:3.0:1787733854.957591:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689961984 00000100:00100000:3.0:1787733854.957640:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1787733854.957649:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1874574689961984:12345-192.168.201.34@tcp:38: 00010000:00080000:3.0:1787733854.957689:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:3.0:1787733854.957751:0:5833:0:(genops.c:1385:class_connect()) connect: client a2c26bfa-a021-441a-9db5-0c3742b5640d, cookie 0x45228d86de4d556a 00000004:00100000:3.0:1787733854.957783:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787733854.957790:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787733854.992343:0:5833:0:(import.c:65:import_set_state_nolock()) ffff891ec6d31800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787733854.992419:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2353:x1874574689961984:12345-192.168.201.34@tcp:38: Request processed in 34768us (34985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733854.992431:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1787733855.034426:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705712512:0@lo:400: 00000100:00100000:0.0:1787733855.034501:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733855.034566:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787733855.034572:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874574705712384:0@lo:400: 00000100:00100000:0.0:1787733855.034594:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733855.034624:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705712512 00000100:00100000:0.0:1787733855.034630:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705712512 00000100:00100000:0.0:1787733855.034684:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787733855.034693:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705712512:12345-0@lo:400: 00000100:00100000:0.0:1787733855.034747:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705712512:12345-0@lo:400: Request processed in 55us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733855.034754:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787733855.034775:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705712384 00000100:00100000:0.0:1787733855.034778:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705712384 00000100:00100000:0.0:1787733855.034801:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787733855.034806:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874574705712384:12345-0@lo:400: 00000100:00100000:0.0:1787733855.034831:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874574705712384:12345-0@lo:400: Request processed in 25us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733855.034836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787733855.034850:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787733855.034854:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787733855.034882:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c7ad80 x1874574705712384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733855.034895:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874574705712384:0@lo:400: 00010000:00080000:0.0:1787733855.034904:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c7b480 x1874574705712512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733855.034912:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705712512:0@lo:400: 00000100:00100000:1.0:1787733855.035137:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705712128:0@lo:400: 00000100:00100000:1.0:1787733855.035207:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733855.035239:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705712640:0@lo:400: 00000100:00100000:1.0:1787733855.035259:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733855.035282:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787733855.035287:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705712256:0@lo:400: 00000100:00100000:1.0:1787733855.035307:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733855.035320:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705712768:0@lo:400: 00000100:00100000:1.0:1787733855.035337:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733855.035398:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705712128 00000100:00100000:3.0:1787733855.035403:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705712128 00000100:00100000:3.0:1787733855.035433:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787733855.035440:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705712128:12345-0@lo:400: 00000100:00100000:3.0:1787733855.035473:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705712128:12345-0@lo:400: Request processed in 34us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733855.035489:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787733855.035630:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705712128:0@lo:400: 00000100:00100000:2.0:1787733855.035705:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705712768 00000100:00100000:2.0:1787733855.035710:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705712768 00000100:00100000:2.0:1787733855.035753:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787733855.035760:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705712768:12345-0@lo:400: 00000100:00100000:2.0:1787733855.035799:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705712768:12345-0@lo:400: Request processed in 39us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733855.035805:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787733855.035834:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6d9dc00 x1874574705712768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733855.035842:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787733855.035853:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705712768:0@lo:400: 00000100:00080000:1.0:1787733855.035940:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787733855.035989:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705712640 00000100:00100000:0.0:1787733855.035994:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705712640 00000100:00100000:0.0:1787733855.036035:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705712256 00000100:00100000:0.0:1787733855.036038:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705712256 00000100:00100000:0.0:1787733855.036052:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787733855.036057:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705712640:12345-0@lo:400: 00000100:00100000:2.0:1787733855.036147:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787733855.036171:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787733855.036278:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787733855.036285:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705712256:12345-0@lo:400: 00000100:00100000:0.0:1787733855.036345:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705712640:12345-0@lo:400: Request processed in 286us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733855.036363:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787733855.036463:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733855.036591:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705712256:12345-0@lo:400: Request processed in 306us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733855.036597:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787733855.037438:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c7b800 x1874574705712640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733855.037453:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705712640:0@lo:400: 00010000:00080000:2.0:1787733855.037681:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c78700 x1874574705712256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787733871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733855.037705:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705712256:0@lo:400: 00000100:00100000:0.0:1787733855.550301:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787733855.550332:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705712896:0@lo:13: 00000100:00100000:0.0:1787733855.550408:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733855.550688:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705712896 00000100:00100000:2.0:1787733855.550697:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705712896 00000100:00100000:2.0:1787733855.550752:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787733855.550762:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705712896:12345-0@lo:13: 00002000:00000024:2.0:1787733855.550801:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733855.550853:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705712896:12345-0@lo:13: Request processed in 92us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733855.550860:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787733855.550977:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff05c00 x1874574705712896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733855.550996:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705712896:0@lo:13: 00010000:00010000:2.0:1787733855.674539:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733855.995587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733855.995740:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689962112 00000100:00100000:0.0:1787733855.995750:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689962112 00000100:00100000:0.0:1787733855.995834:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1787733855.995845:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:0:x1874574689962112:12345-192.168.201.34@tcp:41: 00000004:00000024:0.0:1787733855.995890:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787733855.995959:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:0:x1874574689962112:12345-192.168.201.34@tcp:41: Request processed in 116us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733855.995968:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00080000:2.0:1787733855.996675:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733855.998360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733855.998591:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689962240 00000100:00100000:2.0:1787733855.998600:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689962240 00000100:00100000:2.0:1787733855.998666:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1787733855.998676:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:5579:x1874574689962240:12345-192.168.201.34@tcp:41: 00000004:00000024:2.0:1787733855.998706:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787733855.998769:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:5579:x1874574689962240:12345-192.168.201.34@tcp:41: Request processed in 95us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733855.998778:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:0.0:1787733856.001045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733856.001134:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689962368 00000100:00100000:3.0:1787733856.001144:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689962368 00000100:00100000:3.0:1787733856.001236:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787733856.001247:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:5579:x1874574689962368:12345-192.168.201.34@tcp:40: 00000100:00100000:3.0:1787733856.001346:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:5579:x1874574689962368:12345-192.168.201.34@tcp:40: Request processed in 101us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733856.001354:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1787733856.004891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733856.004978:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689962496 00000100:00100000:0.0:1787733856.004988:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689962496 00000100:00100000:0.0:1787733856.005031:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1787733856.005039:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1874574689962496:12345-192.168.201.34@tcp:8: 00010000:00080000:0.0:1787733856.005071:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1787733856.005109:0:6682:0:(genops.c:1385:class_connect()) connect: client a2c26bfa-a021-441a-9db5-0c3742b5640d, cookie 0x45228d86de4d5571 00002000:00100000:0.0:1787733856.005121:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a2c26bfa-a021-441a-9db5-0c3742b5640d/ffff891ec73ee800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787733856.005146:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787733856.005703:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787733856.005737:0:6682:0:(import.c:65:import_set_state_nolock()) ffff891ec6c82000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787733856.005811:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2353:x1874574689962496:12345-192.168.201.34@tcp:8: Request processed in 771us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733856.005820:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1787733856.008439:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733856.008494:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733856.008673:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689962624 00000100:00100000:2.0:1787733856.008683:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689962624 00000100:00100000:2.0:1787733856.008725:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1787733856.008734:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874574689962624:12345-192.168.201.34@tcp:8: 00010000:00080000:2.0:1787733856.008766:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1787733856.008816:0:6679:0:(genops.c:1385:class_connect()) connect: client a2c26bfa-a021-441a-9db5-0c3742b5640d, cookie 0x45228d86de4d5578 00002000:00100000:2.0:1787733856.008829:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a2c26bfa-a021-441a-9db5-0c3742b5640d/ffff891efe969000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787733856.008841:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787733856.009244:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787733856.009273:0:6679:0:(import.c:65:import_set_state_nolock()) ffff891efe96a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787733856.009346:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2353:x1874574689962624:12345-192.168.201.34@tcp:8: Request processed in 611us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733856.009354:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1787733856.009725:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689962752 00000100:00100000:0.0:1787733856.009731:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689962752 00000100:00100000:0.0:1787733856.009773:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787733856.009783:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:5579:x1874574689962752:12345-192.168.201.34@tcp:33: 00000100:00100000:2.0:1787733856.019109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733856.019567:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689962880 00000100:00100000:3.0:1787733856.019577:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689962880 00000100:00100000:3.0:1787733856.019664:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:3.0:1787733856.019675:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2354:x1874574689962880:12345-192.168.201.34@tcp:400: 00000100:00100000:3.0:1787733856.019755:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2354:x1874574689962880:12345-192.168.201.34@tcp:400: Request processed in 82us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733856.019764:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 127 00000004:00080000:0.0:1787733856.035926:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26080us 00000004:00200000:0.0:1787733856.042386:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787733856.042644:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:5579:x1874574689962752:12345-192.168.201.34@tcp:33: Request processed in 32855us (34142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733856.042666:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787733856.058538:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705713024:0@lo:13: 00000100:00100000:0.0:1787733856.058618:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733856.058752:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705713024 00000100:00100000:2.0:1787733856.058761:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705713024 00000100:00100000:2.0:1787733856.058819:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787733856.058829:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705713024:12345-0@lo:13: 00002000:00000024:2.0:1787733856.058854:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733856.058901:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705713024:12345-0@lo:13: Request processed in 73us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733856.058908:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787733856.060731:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef5d5d500 x1874574705713024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733856.060758:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705713024:0@lo:13: 00000100:00100000:2.0:1787733856.231859:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733856.231971:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689963008 00000100:00100000:0.0:1787733856.231982:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689963008 00000100:00100000:0.0:1787733856.232063:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1787733856.232072:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:5617:x1874574689963008:12345-192.168.201.34@tcp:101: 00010000:00010000:0.0:1787733856.232095:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733856.232126:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d557f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19339 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733856.232294:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d5586 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733856.232310:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d5586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733856.232326:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d5586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733856.232819:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787733856.232824:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733856.232907:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d5586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733856.232938:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d557f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19339 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733856.232957:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d5586 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19339 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733856.232966:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771000) 00010000:00010000:0.0:1787733856.232969:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787733856.232974:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659200, rc 0) 00000100:00100000:0.0:1787733856.233118:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:5617:x1874574689963008:12345-192.168.201.34@tcp:101: Request processed in 1045us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733856.233126:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00010000:00010000:2.0:1787733856.698574:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787733857.651957:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00010000:00010000:2.0:1787733857.722449:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733858.167077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733858.167274:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689963136 00000100:00100000:3.0:1787733858.167286:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689963136 00000100:00100000:3.0:1787733858.167372:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1787733858.167385:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:5669:x1874574689963136:12345-192.168.201.34@tcp:41: 00000004:00000024:3.0:1787733858.167439:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787733858.167530:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:5669:x1874574689963136:12345-192.168.201.34@tcp:41: Request processed in 148us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733858.167539:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1787733858.170273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733858.170369:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689963264 00000100:00100000:3.0:1787733858.170379:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689963264 00000100:00100000:3.0:1787733858.170453:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1787733858.170466:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:5669:x1874574689963264:12345-192.168.201.34@tcp:13: 00002000:00000024:3.0:1787733858.170510:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787733858.170670:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733858.170675:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733858.170695:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:5669:x1874574689963264:12345-192.168.201.34@tcp:13: Request processed in 231us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733858.170704:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1787733858.179586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733858.179853:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689963392 00000100:00100000:0.0:1787733858.179864:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689963392 00000100:00100000:0.0:1787733858.180012:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1787733858.180023:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:5669:x1874574689963392:12345-192.168.201.34@tcp:13: 00002000:00000024:0.0:1787733858.180074:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787733858.180139:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:5669:x1874574689963392:12345-192.168.201.34@tcp:13: Request processed in 118us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733858.180146:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00080000:2.0:1787733858.180910:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787733858.752270:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733859.770417:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733860.158054:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705713152:0@lo:400: 00000100:00100000:3.0:1787733860.158145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733860.158218:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705713664:0@lo:400: 00000100:00100000:3.0:1787733860.158258:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733860.158287:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787733860.158295:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705713280:0@lo:400: 00000100:00100000:3.0:1787733860.158318:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733860.158356:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705713664 00000100:00100000:3.0:1787733860.158364:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705713664 00000100:00100000:3.0:1787733860.158430:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705713280 00000100:00100000:3.0:1787733860.158434:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705713280 00000100:00100000:3.0:1787733860.158459:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787733860.158469:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705713664:12345-0@lo:400: 00000100:00100000:3.0:1787733860.158525:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705713664:12345-0@lo:400: Request processed in 57us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733860.158533:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787733860.158571:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787733860.158588:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705713280:12345-0@lo:400: 00000100:00100000:3.0:1787733860.158620:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705713280:12345-0@lo:400: Request processed in 42us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733860.158625:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787733860.158645:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733860.158684:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705713280:0@lo:400: 00000100:00100000:3.0:1787733860.158710:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705713664:0@lo:400: 00000100:00100000:0.0:1787733860.162680:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705713408:0@lo:400: 00000100:00100000:1.0:1787733860.164216:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705713536:0@lo:400: 00000100:00100000:1.0:1787733860.164289:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733860.164352:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705713152 00000100:00100000:1.0:1787733860.164361:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705713152 00000100:00100000:1.0:1787733860.164406:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787733860.164416:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705713152:12345-0@lo:400: 00000100:00100000:1.0:1787733860.164472:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705713152:12345-0@lo:400: Request processed in 57us (6327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733860.164480:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787733860.164644:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705713536 00000100:00100000:1.0:1787733860.164648:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705713536 00000100:00100000:1.0:1787733860.164763:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787733860.164773:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705713536:12345-0@lo:400: 00000100:00100000:1.0:1787733860.164824:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705713536:12345-0@lo:400: Request processed in 53us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733860.164831:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787733860.165964:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733860.166858:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705713408 00000100:00100000:3.0:1787733860.166869:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705713408 00000100:00100000:3.0:1787733860.166921:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787733860.166931:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705713408:12345-0@lo:400: 00000100:00100000:3.0:1787733860.168191:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705713408:12345-0@lo:400: Request processed in 1253us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733860.168212:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787733860.171926:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733860.172276:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705713152:0@lo:400: 00000100:00080000:1.0:1787733860.172340:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787733860.172372:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ed2004a80 x1874574705713536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733860.172386:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705713536:0@lo:400: 00000100:00100000:1.0:1787733860.172484:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733860.172497:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705713792:0@lo:400: 00000100:00100000:1.0:1787733860.172565:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733860.172624:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705713792 00000100:00100000:1.0:1787733860.172630:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705713792 00000100:00100000:1.0:1787733860.172685:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787733860.173204:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705713408:0@lo:400: 00000100:00080000:0.0:1787733860.173244:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787733860.174407:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705713792:12345-0@lo:400: 00000100:00100000:1.0:1787733860.174501:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705713792:12345-0@lo:400: Request processed in 109us (1937us total) trans 0 rc 0/0 00010000:00080000:0.0:1787733860.182121:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe93a300 x1874574705713792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733860.182142:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705713792:0@lo:400: 00000100:00100000:1.0:1787733860.183229:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000001:00100000:2.0:1787733860.218433:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000001:00100000:2.0:1787733860.233990:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000001:02000400:2.0:1787733860.475557:0:8279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787733860.668194:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705713920:0@lo:13: 00000100:00100000:0.0:1787733860.668277:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733860.669944:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705713920 00000100:00100000:3.0:1787733860.669959:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705713920 00000100:00100000:3.0:1787733860.670016:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787733860.670027:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705713920:12345-0@lo:13: 00002000:00000024:3.0:1787733860.670065:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733860.670137:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705713920:12345-0@lo:13: Request processed in 112us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733860.670145:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787733860.670431:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff04380 x1874574705713920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733860.670451:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705713920:0@lo:13: 00010000:00010000:2.0:1787733860.794316:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733861.178635:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787733861.178669:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705714048:0@lo:13: 00000100:00100000:0.0:1787733861.178753:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733861.179797:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705714048 00000100:00100000:2.0:1787733861.179807:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705714048 00000100:00100000:2.0:1787733861.179871:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787733861.179882:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705714048:12345-0@lo:13: 00002000:00000024:2.0:1787733861.179923:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733861.179997:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705714048:12345-0@lo:13: Request processed in 117us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733861.180005:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787733861.180510:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef5d5df80 x1874574705714048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733861.180533:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705714048:0@lo:13: 00000100:00100000:1.0:1787733861.493408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733861.493885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733861.493970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733861.493999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733861.494046:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689963648 00000100:00100000:3.0:1787733861.494056:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689963648 00000100:00100000:3.0:1787733861.494118:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:3.0:1787733861.494127:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689963648:12345-192.168.201.34@tcp:400: 00000100:00100000:3.0:1787733861.494224:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689963648:12345-192.168.201.34@tcp:400: Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733861.494231:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00080000:3.0:1787733861.494252:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787733861.496031:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689963520 00000100:00100000:0.0:1787733861.496044:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689963520 00000100:00100000:0.0:1787733861.496103:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:0.0:1787733861.496112:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2355:x1874574689963520:12345-192.168.201.34@tcp:400: 00000100:00100000:0.0:1787733861.496214:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2355:x1874574689963520:12345-192.168.201.34@tcp:400: Request processed in 103us (2819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733861.496222:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:2.0:1787733861.499895:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689963776 00000100:00100000:2.0:1787733861.499914:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689963776 00000100:00080000:0.0:1787733861.500019:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787733861.502014:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689963904 00000100:00100000:3.0:1787733861.502029:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689963904 00000100:00100000:3.0:1787733861.502122:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787733861.502136:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689963776:12345-192.168.201.34@tcp:400: 00000100:00100000:3.0:1787733861.502275:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689963776:12345-192.168.201.34@tcp:400: Request processed in 142us (8390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733861.502283:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787733861.502301:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1787733861.502309:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689963904:12345-192.168.201.34@tcp:400: 00000100:00100000:3.0:1787733861.502336:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689963904:12345-192.168.201.34@tcp:400: Request processed in 27us (8336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733861.502342:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00080000:1.0:1787733861.504300:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787733861.818676:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733862.856475:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733863.866242:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787733863.910716:0:8427:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9c55c330 20000000:00000080:1.0:1787733863.910738:0:8427:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff891eefb47c00 uarg=0000000000000000 20000000:01000000:1.0:1787733863.910927:0:8427:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787733863.910931:0:8427:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787733863.910939:0:8427:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787733863.910945:0:8427:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787733863.910950:0:8427:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787733863.910965:0:8427:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787733863.910968:0:8427:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787733863.911432:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787733863.911436:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787733863.912458:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787733863.913075:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787733863.913132:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787733863.913600:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787733863.913618:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787733863.913621:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787733863.914419:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787733863.914785:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787733863.914904:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787733863.914945:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787733863.914959:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787733863.914962:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787733863.915822:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787733863.916647:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787733863.916713:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787733863.916756:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787733863.916772:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787733863.916775:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787733863.917647:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787733863.918110:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787733863.918293:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787733863.918411:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1787733863.918428:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787733863.918450:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918469:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec0030a00/0x45228d86de4d548a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5483 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918477:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020fe400/0x45228d86de4d54b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d54ad expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918484:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020ff600/0x45228d86de4d54de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d54d7 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918491:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec13caa00/0x45228d86de4d54ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d54e5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918498:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec0031800/0x45228d86de4d54fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d54f3 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918505:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020c0800/0x45228d86de4d5516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d550f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918520:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec6659000/0x45228d86de4d5540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5539 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918531:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891efe7ec000/0x45228d86de4d554e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df192d7 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918538:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df192de expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918556:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918598:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192de expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918614:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192de expref: 9 pid: 5825 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.918630:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714176:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733863.918787:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891efe7ec000/0x45228d86de4d554e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192d7 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918797:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891efe7ec000/0x45228d86de4d554e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192d7 expref: 9 pid: 5826 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.918805:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714304:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733863.918902:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec6659000/0x45228d86de4d5540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d5539 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.918911:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec6659000/0x45228d86de4d5540 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d5539 expref: 18 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.918921:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714432:0@lo:104: 00000100:00100000:2.0:1787733863.918963:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787733863.919005:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020c0800/0x45228d86de4d5516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d550f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.919025:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891f020c0800/0x45228d86de4d5516 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d550f expref: 18 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.919035:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714560:0@lo:104: 00000100:00100000:2.0:1787733863.919061:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787733863.919099:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec0031800/0x45228d86de4d54fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d54f3 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.919107:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec0031800/0x45228d86de4d54fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d54f3 expref: 18 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.919116:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714688:0@lo:104: 00010000:00010000:2.0:1787733863.919142:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec13caa00/0x45228d86de4d54ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d54e5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.919149:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec13caa00/0x45228d86de4d54ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d54e5 expref: 18 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.919184:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714816:0@lo:104: 00010000:00010000:2.0:1787733863.919211:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020ff600/0x45228d86de4d54de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d54d7 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.919220:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891f020ff600/0x45228d86de4d54de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d54d7 expref: 18 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.919228:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714944:0@lo:104: 00010000:00010000:2.0:1787733863.919249:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020fe400/0x45228d86de4d54b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d54ad expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.919269:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891f020fe400/0x45228d86de4d54b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d54ad expref: 18 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.919277:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705715072:0@lo:104: 00010000:00010000:2.0:1787733863.919315:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec0030a00/0x45228d86de4d548a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d5483 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.919334:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec0030a00/0x45228d86de4d548a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d5483 expref: 18 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.919343:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705715200:0@lo:104: 00000100:00100000:2.0:1787733863.919362:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff891eef58b180 going to sleep for 11 seconds 00000100:00100000:3.0:1787733863.919535:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787733863.919555:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.919568:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.919576:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.919583:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.919592:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.919604:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705714432 00000100:00100000:3.0:1787733863.919611:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705714432 00000100:00100000:3.0:1787733863.919646:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705714560 00000100:00100000:3.0:1787733863.919649:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705714560 00000100:00100000:3.0:1787733863.919659:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705714688 00000100:00100000:3.0:1787733863.919662:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705714688 00000100:00100000:3.0:1787733863.919670:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705714816 00000100:00100000:3.0:1787733863.919672:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705714816 00000100:00100000:3.0:1787733863.919681:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705714944 00000100:00100000:3.0:1787733863.919683:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705714944 00000100:00100000:3.0:1787733863.919691:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705715072 00000100:00100000:3.0:1787733863.919693:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705715072 00000100:00100000:3.0:1787733863.919700:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705715200 00000100:00100000:3.0:1787733863.919702:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705715200 00000100:00100000:3.0:1787733863.919715:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787733863.919731:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+9:8427:x1874574705714432:12345-0@lo:104: 00010000:00010000:3.0:1787733863.919743:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.919796:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787733863.919802:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+9:8427:x1874574705714432:12345-0@lo:104: Request processed in 74us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.919810:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787733863.919838:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787733863.919846:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe91f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+8:8427:x1874574705714560:12345-0@lo:104: 00010000:00010000:3.0:1787733863.919854:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.919886:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787733863.919891:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe91f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+8:8427:x1874574705714560:12345-0@lo:104: Request processed in 47us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.919897:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787733863.919933:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787733863.919940:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+7:8427:x1874574705714688:12345-0@lo:104: 00010000:00010000:3.0:1787733863.919948:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.919974:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787733863.919979:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+7:8427:x1874574705714688:12345-0@lo:104: Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.919984:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787733863.919996:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787733863.920009:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+6:8427:x1874574705714816:12345-0@lo:104: 00010000:00010000:3.0:1787733863.920017:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920043:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787733863.920048:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+6:8427:x1874574705714816:12345-0@lo:104: Request processed in 40us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.920054:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787733863.920066:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787733863.920072:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+5:8427:x1874574705714944:12345-0@lo:104: 00010000:00010000:3.0:1787733863.920079:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920104:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787733863.920109:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+5:8427:x1874574705714944:12345-0@lo:104: Request processed in 38us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.920114:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787733863.920126:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787733863.920131:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+4:8427:x1874574705715072:12345-0@lo:104: 00010000:00010000:3.0:1787733863.920138:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920189:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787733863.920195:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+4:8427:x1874574705715072:12345-0@lo:104: Request processed in 64us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.920201:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787733863.920213:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787733863.920224:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+3:8427:x1874574705715200:12345-0@lo:104: 00010000:00010000:3.0:1787733863.920232:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920257:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787733863.920261:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+3:8427:x1874574705715200:12345-0@lo:104: Request processed in 40us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.920267:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787733863.920284:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787733863.920289:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920296:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030c00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733863.920300:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920309:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733863.920315:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733863.920321:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733863.920363:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920370:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733863.920386:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920402:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec0030c00/0x45228d86de4d5539 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5540 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920416:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787733863.920420:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920425:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733863.920428:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920435:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733863.920441:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733863.920446:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733863.920459:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920465:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733863.920470:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920476:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec0031000/0x45228d86de4d550f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5516 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920485:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787733863.920494:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920500:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1000 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733863.920502:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920508:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733863.920523:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733863.920529:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733863.920542:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920547:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733863.920564:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920570:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d54f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920580:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787733863.920582:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920587:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca800 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733863.920590:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920606:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733863.920612:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733863.920617:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733863.920633:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920638:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733863.920644:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920649:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec13ca800/0x45228d86de4d54e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54ec expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920658:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787733863.920661:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920667:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca000 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733863.920669:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920676:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733863.920682:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733863.920693:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733863.920706:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920711:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733863.920715:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920720:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec13ca000/0x45228d86de4d54d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920728:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787733863.920730:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920735:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030800 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733863.920737:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920743:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733863.920749:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733863.920754:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733863.920765:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920770:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733863.920780:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920787:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec0030800/0x45228d86de4d54ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54b4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920795:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787733863.920798:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920803:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020ff000 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733863.920805:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920811:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733863.920817:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733863.920822:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787733863.920834:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920839:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733863.920843:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920849:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d5483 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d548a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.920861:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733863.920869:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733863.920871:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733863.920878:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733863.920892:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705715328:0@lo:103: 00000100:00100000:3.0:1787733863.920923:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.920950:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705715840:0@lo:103: 00000100:00100000:3.0:1787733863.920970:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.920992:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787733863.920998:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705715456:0@lo:103: 00000100:00100000:3.0:1787733863.921017:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.921032:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705715968:0@lo:103: 00000100:00100000:3.0:1787733863.921061:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.921090:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705715584:0@lo:103: 00000100:00100000:3.0:1787733863.921115:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.921126:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705716096:0@lo:103: 00000100:00100000:3.0:1787733863.921143:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.921177:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787733863.921182:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705715712:0@lo:103: 00000100:00100000:3.0:1787733863.921205:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733863.921228:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705715328 00000100:00100000:3.0:1787733863.921234:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705715328 00010000:00010000:3.0:1787733863.921256:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec6659000/0x45228d86de4d5540 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5539 expref: 19 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733863.921272:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705715840 00000100:00100000:3.0:1787733863.921275:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705715840 00010000:00010000:3.0:1787733863.921284:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020ff600/0x45228d86de4d54de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d54d7 expref: 20 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733863.921307:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705715456 00000100:00100000:3.0:1787733863.921310:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705715456 00010000:00010000:3.0:1787733863.921322:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020c0800/0x45228d86de4d5516 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d550f expref: 21 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733863.921332:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705715968 00000100:00100000:3.0:1787733863.921334:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705715968 00010000:00010000:3.0:1787733863.921344:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020fe400/0x45228d86de4d54b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d54ad expref: 22 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733863.921352:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705715584 00000100:00100000:3.0:1787733863.921355:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705715584 00010000:00010000:3.0:1787733863.921364:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec0031800/0x45228d86de4d54fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d54f3 expref: 23 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733863.921372:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705716096 00000100:00100000:3.0:1787733863.921374:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705716096 00010000:00010000:3.0:1787733863.921382:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec0030a00/0x45228d86de4d548a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5483 expref: 24 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733863.921392:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705715712 00000100:00100000:3.0:1787733863.921395:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705715712 00010000:00010000:3.0:1787733863.921405:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec13caa00/0x45228d86de4d54ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d54e5 expref: 25 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733863.921417:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787733863.921423:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2004000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+25:3312:x1874574705715328:12345-0@lo:103: 00010000:00010000:3.0:1787733863.921433:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733863.921439:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec6659000/0x45228d86de4d5540 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5539 expref: 25 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921459:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec6659000/0x45228d86de4d5540 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d5539 expref: 25 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921476:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733863.921507:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2004000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+25:3312:x1874574705715328:12345-0@lo:103: Request processed in 84us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.921527:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787733863.921541:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787733863.921547:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+24:3312:x1874574705715840:12345-0@lo:103: 00010000:00010000:3.0:1787733863.921555:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733863.921560:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020ff600/0x45228d86de4d54de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d54d7 expref: 24 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921567:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020ff600/0x45228d86de4d54de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d54d7 expref: 24 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921577:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733863.921598:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+24:3312:x1874574705715840:12345-0@lo:103: Request processed in 51us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.921603:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787733863.921615:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787733863.921620:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+23:3312:x1874574705715456:12345-0@lo:103: 00010000:00010000:3.0:1787733863.921627:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733863.921632:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020c0800/0x45228d86de4d5516 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d550f expref: 23 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921639:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020c0800/0x45228d86de4d5516 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d550f expref: 23 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921656:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733863.921678:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+23:3312:x1874574705715456:12345-0@lo:103: Request processed in 58us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.921685:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787733863.921698:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787733863.921705:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+22:3312:x1874574705715968:12345-0@lo:103: 00010000:00010000:3.0:1787733863.921712:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733863.921717:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020fe400/0x45228d86de4d54b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d54ad expref: 22 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921725:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020fe400/0x45228d86de4d54b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d54ad expref: 22 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921734:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733863.921755:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+22:3312:x1874574705715968:12345-0@lo:103: Request processed in 51us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.921761:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787733863.921773:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787733863.921778:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+21:3310:x1874574705715584:12345-0@lo:103: 00010000:00010000:3.0:1787733863.921786:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733863.921790:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec0031800/0x45228d86de4d54fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d54f3 expref: 21 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921798:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec0031800/0x45228d86de4d54fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d54f3 expref: 21 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921806:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733863.921840:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+21:3310:x1874574705715584:12345-0@lo:103: Request processed in 61us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.921846:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787733863.921859:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787733863.921865:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+20:3310:x1874574705716096:12345-0@lo:103: 00010000:00010000:3.0:1787733863.921872:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733863.921876:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec0030a00/0x45228d86de4d548a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5483 expref: 20 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921884:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec0030a00/0x45228d86de4d548a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d5483 expref: 20 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921894:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733863.921915:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+20:3310:x1874574705716096:12345-0@lo:103: Request processed in 51us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.921921:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787733863.921932:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787733863.921939:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705715712:12345-0@lo:103: 00010000:00010000:3.0:1787733863.921946:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733863.921950:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec13caa00/0x45228d86de4d54ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d54e5 expref: 19 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921957:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec13caa00/0x45228d86de4d54ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d54e5 expref: 19 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733863.921965:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733863.921986:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705715712:12345-0@lo:103: Request processed in 47us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733863.921991:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787733863.922056:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705715712:0@lo:103: 00000100:00100000:3.0:1787733863.922066:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705715584:0@lo:103: 00000100:00100000:3.0:1787733863.922072:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705716096:0@lo:103: 00000100:00100000:3.0:1787733863.922105:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705715456:0@lo:103: 00000100:00100000:3.0:1787733863.922113:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705715968:0@lo:103: 00000100:00100000:3.0:1787733863.922120:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705715328:0@lo:103: 00000100:00100000:3.0:1787733863.922127:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705715840:0@lo:103: 00010000:00010000:2.0:1787733863.922447:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec6659000/0x45228d86de4d5540 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d5539 expref: 18 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.922459:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714432:0@lo:104: 00010000:00010000:2.0:1787733863.922470:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020c0800/0x45228d86de4d5516 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d550f expref: 17 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.922479:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714560:0@lo:104: 00010000:00010000:2.0:1787733863.922488:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec0031800/0x45228d86de4d54fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d54f3 expref: 16 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.922496:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714688:0@lo:104: 00010000:00010000:2.0:1787733863.922504:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13caa00/0x45228d86de4d54ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d54e5 expref: 15 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.922524:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714816:0@lo:104: 00010000:00010000:2.0:1787733863.922544:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020ff600/0x45228d86de4d54de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d54d7 expref: 14 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.922553:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714944:0@lo:104: 00010000:00010000:2.0:1787733863.922562:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020fe400/0x45228d86de4d54b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d54ad expref: 13 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.922570:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705715072:0@lo:104: 00010000:00010000:2.0:1787733863.922577:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec0030a00/0x45228d86de4d548a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d5483 expref: 12 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733863.922586:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705715200:0@lo:104: 00000100:00100000:2.0:1787733863.925247:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714176:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733863.925265:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1874574705714304:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733863.925308:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733863.925954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733863.925993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733863.926139:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689964032 00000100:00100000:0.0:1787733863.926148:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689964032 00010000:00010000:0.0:1787733863.926218:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192de expref: 10 pid: 5825 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733863.926249:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689964160 00000100:00100000:0.0:1787733863.926252:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689964160 00010000:00010000:0.0:1787733863.926265:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891efe7ec000/0x45228d86de4d554e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192d7 expref: 11 pid: 5826 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733863.926287:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787733863.926296:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:2355:x1874574689964032:12345-192.168.201.34@tcp:103: 00010000:00010000:0.0:1787733863.926311:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733863.926316:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192de expref: 11 pid: 5825 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926334:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192de expref: 11 pid: 5825 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926353:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5555 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192de expref: 11 pid: 5825 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926370:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733863.926422:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2355:x1874574689964032:12345-192.168.201.34@tcp:103: Request processed in 127us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733863.926446:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787733863.926465:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1787733863.926471:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:2355:x1874574689964160:12345-192.168.201.34@tcp:103: 00010000:00010000:0.0:1787733863.926479:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733863.926484:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891efe7ec000/0x45228d86de4d554e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192d7 expref: 9 pid: 5826 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926493:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891efe7ec000/0x45228d86de4d554e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192d7 expref: 9 pid: 5826 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926503:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891efe7ec000/0x45228d86de4d554e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df192d7 expref: 9 pid: 5826 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926527:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926535:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926550:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926557:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926563:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926570:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926582:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cb000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787733863.926587:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926595:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926606:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733863.926617:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733863.926638:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:2355:x1874574689964160:12345-192.168.201.34@tcp:103: Request processed in 167us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733863.926645:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00010000:00010000:2.0:1787733863.927030:0:8427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.927038:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733863.927045:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13cb000/0x45228d86de4d558d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733864.283650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733864.283815:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689964288 00000100:00100000:3.0:1787733864.283825:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689964288 00000100:00100000:3.0:1787733864.283883:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:3.0:1787733864.283893:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:5593:x1874574689964288:12345-192.168.201.34@tcp:101: 00010000:00010000:3.0:1787733864.283911:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733864.283932:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891efe7edc00/0x45228d86de4d5594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df19340 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733864.283959:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891efe7edc00/0x45228d86de4d5594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19340 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733864.283970:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891efe7edc00/0x45228d86de4d5594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19340 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733864.283980:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7edc00, rc 0) 00000100:00100000:3.0:1787733864.284041:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5593:x1874574689964288:12345-192.168.201.34@tcp:101: Request processed in 149us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733864.284063:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:0.0:1787733864.285853:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733864.288772:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689964416 00000100:00100000:3.0:1787733864.288789:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689964416 00000100:00100000:3.0:1787733864.288861:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:3.0:1787733864.288871:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5593:x1874574689964416:12345-192.168.201.34@tcp:501: 00000100:00100000:3.0:1787733864.289220:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5593:x1874574689964416:12345-192.168.201.34@tcp:501: Request processed in 350us (3373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733864.289228:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1787733864.292925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733864.293213:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689964544 00000100:00100000:0.0:1787733864.293225:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689964544 00000100:00100000:0.0:1787733864.293287:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:0.0:1787733864.293298:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5593:x1874574689964544:12345-192.168.201.34@tcp:503: 00000100:00100000:0.0:1787733864.293549:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5593:x1874574689964544:12345-192.168.201.34@tcp:503: Request processed in 253us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733864.293557:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:2.0:1787733864.299950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733864.300074:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689964672 00000100:00100000:3.0:1787733864.300086:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689964672 00000100:00100000:3.0:1787733864.300148:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:3.0:1787733864.300193:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:6057:x1874574689964672:12345-192.168.201.34@tcp:502: 00000100:00100000:3.0:1787733864.300442:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:6057:x1874574689964672:12345-192.168.201.34@tcp:502: Request processed in 285us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733864.300448:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:2.0:1787733864.305098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733864.305208:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689964800 00000100:00100000:0.0:1787733864.305219:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689964800 00000100:00100000:0.0:1787733864.305272:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:0.0:1787733864.305285:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:6057:x1874574689964800:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787733864.305543:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:6057:x1874574689964800:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 263us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733864.305555:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:2.0:1787733864.307885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733864.308404:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689964928 00000100:00100000:3.0:1787733864.308415:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689964928 00000100:00100000:3.0:1787733864.308516:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:3.0:1787733864.308528:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5593:x1874574689964928:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787733864.308683:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733864.308704:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891efe7ec800/0x45228d86de4d559b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df19347 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733864.308733:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891efe7ec800/0x45228d86de4d559b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19347 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733864.308753:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891efe7ec800/0x45228d86de4d559b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19347 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733864.308759:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec800, rc 0) 00000100:00100000:3.0:1787733864.308816:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5593:x1874574689964928:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 291us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733864.308821:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:2.0:1787733864.313140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733864.313354:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689965056 00000100:00100000:0.0:1787733864.313365:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689965056 00000100:00100000:0.0:1787733864.313423:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:0.0:1787733864.313433:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5593:x1874574689965056:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787733864.314443:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5593:x1874574689965056:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 1005us (1310us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787733864.314454:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 136 00010000:00010000:3.0:1787733864.891401:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733865.282739:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705716480:0@lo:400: 00000100:00100000:2.0:1787733865.282810:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733865.282908:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787733865.282914:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705716352:0@lo:400: 00000100:00100000:2.0:1787733865.282936:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733865.282951:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705716864:0@lo:400: 00000100:00100000:2.0:1787733865.282973:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733865.288888:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705716224:0@lo:400: 00000100:00100000:3.0:1787733865.288967:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733865.289012:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705716736:0@lo:400: 00000100:00100000:3.0:1787733865.289039:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733865.289067:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787733865.289074:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705716608:0@lo:400: 00000100:00100000:3.0:1787733865.289101:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733865.289142:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705716480 00000100:00100000:3.0:1787733865.289151:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705716480 00000100:00100000:3.0:1787733865.289212:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705716352 00000100:00100000:3.0:1787733865.289215:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705716352 00000100:00100000:3.0:1787733865.289226:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705716736 00000100:00100000:3.0:1787733865.289229:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705716736 00000100:00100000:3.0:1787733865.289242:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787733865.289250:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705716480:12345-0@lo:400: 00000100:00100000:3.0:1787733865.289317:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705716480:12345-0@lo:400: Request processed in 66us (6505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.289324:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787733865.289348:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787733865.289355:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705716352:12345-0@lo:400: 00000100:00100000:3.0:1787733865.289633:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705716352:12345-0@lo:400: Request processed in 277us (6694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.289640:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787733865.289653:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787733865.289660:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705716736:12345-0@lo:400: 00000100:00100000:3.0:1787733865.289868:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705716736:12345-0@lo:400: Request processed in 34us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.289878:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787733865.289907:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705716864 00000100:00100000:3.0:1787733865.289911:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705716864 00000100:00100000:3.0:1787733865.289941:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705716608 00000100:00100000:3.0:1787733865.289944:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705716608 00000100:00100000:3.0:1787733865.289965:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787733865.289974:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705716864:12345-0@lo:400: 00000100:00100000:3.0:1787733865.290008:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705716864:12345-0@lo:400: Request processed in 38us (7035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.290015:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787733865.290025:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787733865.290031:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705716608:12345-0@lo:400: 00000100:00100000:3.0:1787733865.290057:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705716608:12345-0@lo:400: Request processed in 28us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.290063:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787733865.290092:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787733865.290097:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787733865.290099:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733865.290144:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705716352:0@lo:400: 00010000:00080000:3.0:1787733865.290180:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59c700 x1874574705716864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733865.290190:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705716864:0@lo:400: 00000100:00100000:3.0:1787733865.290201:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705716480:0@lo:400: 00010000:00080000:3.0:1787733865.290235:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59e680 x1874574705716608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733865.290244:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705716608:0@lo:400: 00000100:00100000:3.0:1787733865.290256:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705716736:0@lo:400: 00000100:00100000:3.0:1787733865.290278:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705716224 00000100:00100000:3.0:1787733865.290280:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705716224 00000100:00100000:3.0:1787733865.290308:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787733865.290314:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:3311:x1874574705716224:12345-0@lo:400: 00000100:00100000:3.0:1787733865.290351:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:3311:x1874574705716224:12345-0@lo:400: Request processed in 37us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.290357:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787733865.291085:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705716224:0@lo:400: 00000100:00100000:1.0:1787733865.787692:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733865.787718:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705716992:0@lo:13: 00000100:00100000:1.0:1787733865.787785:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733865.787958:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705716992 00000100:00100000:2.0:1787733865.787967:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705716992 00000100:00100000:2.0:1787733865.788021:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787733865.788032:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705716992:12345-0@lo:13: 00002000:00000024:2.0:1787733865.788071:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733865.788117:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705716992:12345-0@lo:13: Request processed in 87us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733865.788123:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787733865.788181:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe938380 x1874574705716992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733865.788198:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705716992:0@lo:13: 00000020:00000080:2.0:1787733865.882500:0:8480:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe275d1ff0 20000000:00000080:2.0:1787733865.882583:0:8480:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff891eef7a7c00 uarg=0000000000000000 20000000:01000000:2.0:1787733865.882617:0:8480:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787733865.882622:0:8480:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787733865.882626:0:8480:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787733865.883125:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787733865.883403:0:8480:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787733865.886032:0:8480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787733865.886070:0:8480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787733865.886112:0:8480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787733865.886125:0:8480:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787733865.886139:0:8480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.886433:0:8480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020c1e00/0x45228d86de4d53cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d53c6 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.886442:0:8480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec13ca600/0x45228d86de4d544b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5444 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.886446:0:8480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec0031c00/0x45228d86de4d54a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d549f expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.886455:0:8480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec6658400/0x45228d86de4d5563 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1930f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.886462:0:8480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.886519:0:8480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec6658400/0x45228d86de4d5563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1930f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.886533:0:8480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec6658400/0x45228d86de4d5563 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1930f expref: 9 pid: 5827 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733865.886548:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8480:1874574705717120:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733865.886668:0:8480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec0031c00/0x45228d86de4d54a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d549f expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.886676:0:8480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec0031c00/0x45228d86de4d54a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d549f expref: 11 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733865.886692:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8480:1874574705717248:0@lo:104: 00000100:00100000:2.0:1787733865.886730:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787733865.886770:0:8480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec13ca600/0x45228d86de4d544b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d5444 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.886778:0:8480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec13ca600/0x45228d86de4d544b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d5444 expref: 11 pid: 5827 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733865.886786:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8480:1874574705717376:0@lo:104: 00000100:00100000:2.0:1787733865.886808:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787733865.886829:0:8480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020c1e00/0x45228d86de4d53cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d53c6 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.886836:0:8480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891f020c1e00/0x45228d86de4d53cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d53c6 expref: 11 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733865.886842:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8480:1874574705717504:0@lo:104: 00000100:00100000:2.0:1787733865.886855:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082480 going to sleep for 11 seconds 00000100:00100000:1.0:1787733865.886968:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787733865.886984:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.886993:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705717248 00000100:00100000:1.0:1787733865.886998:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705717248 00000100:00100000:1.0:1787733865.887028:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705717376 00000100:00100000:1.0:1787733865.887030:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705717376 00000100:00100000:1.0:1787733865.887035:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705717504 00000100:00100000:1.0:1787733865.887036:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705717504 00000100:00100000:1.0:1787733865.887044:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787733865.887049:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+5:8480:x1874574705717248:12345-0@lo:104: 00010000:00010000:1.0:1787733865.887058:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.887105:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787733865.887113:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+5:8480:x1874574705717248:12345-0@lo:104: Request processed in 64us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733865.887118:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787733865.887131:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787733865.887134:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe813c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+4:8480:x1874574705717376:12345-0@lo:104: 00010000:00010000:1.0:1787733865.887139:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.887284:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787733865.887299:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe813c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+4:8480:x1874574705717376:12345-0@lo:104: Request processed in 154us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733865.887304:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787733865.887328:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787733865.887332:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+3:8480:x1874574705717504:12345-0@lo:104: 00010000:00010000:1.0:1787733865.887337:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020c0000/0x45228d86de4d53c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.887356:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787733865.887359:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:df19622b-ae94-4c8d-b052-574898624480+3:8480:x1874574705717504:12345-0@lo:104: Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733865.887362:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787733865.887949:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787733865.887957:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.887966:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1a00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733865.887970:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.887990:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733865.887997:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733865.888004:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787733865.888046:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888053:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733865.888071:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888077:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d549f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d54a6 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888089:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787733865.888092:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888097:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1c00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733865.888100:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888105:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733865.888111:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733865.888121:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787733865.888137:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888143:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733865.888148:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888183:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d5444 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d544b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888192:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787733865.888195:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020c0000/0x45228d86de4d53c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888201:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0000 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733865.888204:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020c0000/0x45228d86de4d53c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888209:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020c0000/0x45228d86de4d53c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733865.888214:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020c0000/0x45228d86de4d53c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733865.888219:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787733865.888232:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020c0000/0x45228d86de4d53c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888237:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787733865.888259:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020c0000/0x45228d86de4d53c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888266:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020c0000/0x45228d86de4d53c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d53cd expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.888281:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733865.888283:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733865.888285:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733865.888349:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733865.888363:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705717632:0@lo:103: 00000100:00100000:3.0:1787733865.888405:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733865.888629:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8480:1874574705717248:0@lo:104: 00000100:00100000:2.0:1787733865.888640:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8480:1874574705717376:0@lo:104: 00000100:00100000:2.0:1787733865.888647:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8480:1874574705717504:0@lo:104: 00000100:00100000:3.0:1787733865.888788:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787733865.888795:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705717760:0@lo:103: 00000100:00100000:3.0:1787733865.888819:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733865.888952:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705717888:0@lo:103: 00000100:00100000:3.0:1787733865.888977:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733865.890841:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705717632 00000100:00100000:2.0:1787733865.890856:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705717632 00010000:00010000:2.0:1787733865.890896:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec0031c00/0x45228d86de4d54a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d549f expref: 12 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733865.890930:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705717760 00000100:00100000:2.0:1787733865.890941:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705717760 00010000:00010000:2.0:1787733865.890956:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec13ca600/0x45228d86de4d544b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5444 expref: 13 pid: 5827 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733865.890969:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705717888 00000100:00100000:2.0:1787733865.890971:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705717888 00010000:00010000:2.0:1787733865.890982:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020c1e00/0x45228d86de4d53cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d53c6 expref: 14 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733865.890996:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787733865.891004:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+14:3310:x1874574705717632:12345-0@lo:103: 00010000:00010000:2.0:1787733865.891018:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733865.891024:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec0031c00/0x45228d86de4d54a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d549f expref: 14 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891035:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec0031c00/0x45228d86de4d54a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d549f expref: 14 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891052:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec0031c00/0x45228d86de4d54a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d549f expref: 14 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891069:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733865.891125:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+13:3310:x1874574705717632:12345-0@lo:103: Request processed in 121us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733865.891132:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787733865.891151:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787733865.891182:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+12:3310:x1874574705717760:12345-0@lo:103: 00010000:00010000:2.0:1787733865.891189:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733865.891194:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec13ca600/0x45228d86de4d544b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5444 expref: 12 pid: 5827 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891211:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec13ca600/0x45228d86de4d544b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d5444 expref: 12 pid: 5827 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891221:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13ca600/0x45228d86de4d544b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d5444 expref: 12 pid: 5827 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891231:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733865.891260:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+11:3310:x1874574705717760:12345-0@lo:103: Request processed in 81us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733865.891265:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787733865.891274:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787733865.891278:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+10:3312:x1874574705717888:12345-0@lo:103: 00010000:00010000:2.0:1787733865.891285:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733865.891288:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020c1e00/0x45228d86de4d53cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d53c6 expref: 10 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891296:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020c1e00/0x45228d86de4d53cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d53c6 expref: 10 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891306:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020c1e00/0x45228d86de4d53cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d53c6 expref: 10 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891314:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733865.891339:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+9:3312:x1874574705717888:12345-0@lo:103: Request processed in 60us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733865.891345:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787733865.891587:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705717760:0@lo:103: 00000100:00100000:3.0:1787733865.891593:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705717632:0@lo:103: 00000100:00100000:3.0:1787733865.891670:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705717888:0@lo:103: 00000100:00100000:2.0:1787733865.891750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733865.891763:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689965184 00000100:00100000:2.0:1787733865.891771:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689965184 00010000:00010000:2.0:1787733865.891786:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec6658400/0x45228d86de4d5563 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1930f expref: 10 pid: 5827 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733865.891805:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:2.0:1787733865.891811:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2355:x1874574689965184:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733865.891820:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733865.891825:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec6658400/0x45228d86de4d5563 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1930f expref: 10 pid: 5827 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891834:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec6658400/0x45228d86de4d5563 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1930f expref: 10 pid: 5827 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891845:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891851:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891864:0:7616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891870:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891876:0:7616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891882:0:7616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891888:0:7616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787733865.891899:0:7616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891907:0:7616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891917:0:7616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.891927:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733865.891965:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2355:x1874574689965184:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 154us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733865.891970:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00010000:00010000:3.0:1787733865.892120:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec6658400/0x45228d86de4d5563 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1930f expref: 9 pid: 5827 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733865.892133:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8480:1874574705717120:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733865.892184:0:8480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.892204:0:8480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.892210:0:8480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.892216:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d55a2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.915368:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787733865.922252:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787733865.922260:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891ef0329800 from 39 10000000:01000000:1.0:1787733865.922266:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787733865.922309:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.922322:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.922344:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733865.922366:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718016:0@lo:101: 00000100:00100000:1.0:1787733865.922426:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.922472:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787733865.922643:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705718016 00000100:00100000:0.0:1787733865.922651:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705718016 00000100:00100000:0.0:1787733865.922706:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787733865.922717:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+9:5829:x1874574705718016:12345-0@lo:101: 00010000:00010000:0.0:1787733865.922731:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733865.922745:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6659600/0x45228d86de4d55b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d55a9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733865.922770:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6659600/0x45228d86de4d55b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d55a9 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733865.922780:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6659600/0x45228d86de4d55b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d55a9 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733865.922790:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659600, rc 0) 00000100:00100000:0.0:1787733865.922837:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+10:5829:x1874574705718016:12345-0@lo:101: Request processed in 122us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733865.922845:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787733865.922953:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718016:0@lo:101: 00010000:00010000:1.0:1787733865.922978:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.922987:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733865.923037:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718144:0@lo:501: 00000100:00100000:1.0:1787733865.923075:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.923099:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733865.923142:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705718144 00000100:00100000:3.0:1787733865.923146:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705718144 00000100:00100000:3.0:1787733865.923212:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787733865.923219:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+10:5829:x1874574705718144:12345-0@lo:501: 00000100:00100000:3.0:1787733865.923496:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+10:5829:x1874574705718144:12345-0@lo:501: Request processed in 277us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.923512:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787733865.923744:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718144:0@lo:501: 00000100:00100000:1.0:1787733865.923774:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718272:0@lo:503: 00000100:00100000:1.0:1787733865.923811:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.923843:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787733865.923895:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705718272 00000100:00100000:0.0:1787733865.923905:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705718272 00000100:00100000:0.0:1787733865.923940:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787733865.923947:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+10:5829:x1874574705718272:12345-0@lo:503: 00000100:00100000:0.0:1787733865.924220:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+10:5829:x1874574705718272:12345-0@lo:503: Request processed in 273us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733865.924227:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787733865.924328:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718272:0@lo:503: 00000100:00100000:1.0:1787733865.924523:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8483:1874574705718400:0@lo:502: 00000100:00100000:1.0:1787733865.924558:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.924578:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705718400 00000100:00100000:1.0:1787733865.924586:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705718400 00000100:00100000:1.0:1787733865.924603:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787733865.924608:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:8483:x1874574705718400:12345-0@lo:502: 00000100:00100000:1.0:1787733865.924766:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:8483:x1874574705718400:12345-0@lo:502: Request processed in 157us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733865.924773:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787733865.924808:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787733865.924819:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8483:1874574705718400:0@lo:502: 00000100:00100000:1.0:1787733865.924852:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8483:1874574705718528:0@lo:502: 00000100:00100000:1.0:1787733865.924881:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.924899:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705718528 00000100:00100000:1.0:1787733865.924902:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705718528 00000100:00100000:1.0:1787733865.924918:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787733865.924923:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:8483:x1874574705718528:12345-0@lo:502: 00000100:00100000:1.0:1787733865.925047:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:8483:x1874574705718528:12345-0@lo:502: Request processed in 123us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733865.925053:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787733865.925078:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787733865.925089:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8483:1874574705718528:0@lo:502: 00000040:00080000:1.0:1787733865.925106:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787733865.925152:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787733865.925187:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787733865.925196:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.925205:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733865.925224:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787733865.925227:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787733865.925230:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787733865.925263:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.925270:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.925278:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733865.925289:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718656:0@lo:101: 00000100:00100000:1.0:1787733865.925313:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.925332:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787733865.925343:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705718656 00000100:00100000:1.0:1787733865.925346:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705718656 00000100:00100000:1.0:1787733865.925364:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787733865.925369:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:5829:x1874574705718656:12345-0@lo:101: 00010000:00010000:1.0:1787733865.925377:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733865.925387:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891f020fe400/0x45228d86de4d55be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d55b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.925405:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020fe400/0x45228d86de4d55be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d55b7 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.925414:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891f020fe400/0x45228d86de4d55be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d55b7 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.925431:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020fe400, rc 0) 00000100:00100000:1.0:1787733865.925460:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705718656:12345-0@lo:101: Request processed in 90us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733865.925466:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787733865.925522:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718656:0@lo:101: 00010000:00010000:1.0:1787733865.925533:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.925541:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733865.925577:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718784:0@lo:501: 00000100:00100000:1.0:1787733865.925600:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.925613:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787733865.925624:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705718784 00000100:00100000:1.0:1787733865.925627:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705718784 00000100:00100000:1.0:1787733865.925642:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787733865.925647:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705718784:12345-0@lo:501: 00000100:00100000:1.0:1787733865.925869:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705718784:12345-0@lo:501: Request processed in 220us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733865.925875:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787733865.925982:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718784:0@lo:501: 00000100:00100000:1.0:1787733865.926005:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718912:0@lo:503: 00000100:00100000:1.0:1787733865.926035:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.926049:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787733865.926065:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705718912 00000100:00100000:1.0:1787733865.926069:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705718912 00000100:00100000:1.0:1787733865.926084:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787733865.926089:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705718912:12345-0@lo:503: 00000100:00100000:1.0:1787733865.926222:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705718912:12345-0@lo:503: Request processed in 132us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733865.926228:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787733865.926257:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705718912:0@lo:503: 00000100:00100000:0.0:1787733865.937116:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8484:1874574705719040:0@lo:502: 00000100:00100000:0.0:1787733865.937230:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733865.937854:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787733865.938612:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705719040 00000100:00100000:2.0:1787733865.938622:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705719040 00000100:00100000:2.0:1787733865.938670:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787733865.938679:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:8484:x1874574705719040:12345-0@lo:502: 00000100:00100000:2.0:1787733865.938937:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+11:8484:x1874574705719040:12345-0@lo:502: Request processed in 259us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733865.938945:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787733865.939354:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8484:1874574705719040:0@lo:502: 00000020:01000000:3.0:1787733865.939391:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787733865.939401:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733865.939404:0:8484:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787733865.939415:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787733865.939451:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8484:1874574705719168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733865.939584:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733865.939613:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787733865.939665:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705719168 00000100:00100000:0.0:1787733865.939671:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705719168 00000100:00100000:0.0:1787733865.939709:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787733865.939717:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:8484:x1874574705719168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733865.939873:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:8484:x1874574705719168:12345-0@lo:502:llog_process_th.0 Request processed in 156us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733865.939880:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787733865.940056:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8484:1874574705719168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787733865.940073:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787733865.940078:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733865.940084:0:8484:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787733865.940089:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787733865.940661:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787733865.940684:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787733865.940694:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733865.940705:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733865.940715:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787733865.940717:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ef0329800 from 4 10000000:01000000:0.0:1787733865.940721:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787733865.940751:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733865.940765:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733865.940775:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733865.940793:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705719296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787733865.940829:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733865.940895:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733865.944616:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705719296 00000100:00100000:3.0:1787733865.944633:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705719296 00000100:00100000:0.0:1787733865.947199:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787733865.947214:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+11:5829:x1874574705719296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787733865.947230:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733865.947261:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6658400/0x45228d86de4d55cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d55c5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733865.947287:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6658400/0x45228d86de4d55cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d55c5 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733865.947299:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6658400/0x45228d86de4d55cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d55c5 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733865.947309:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658400, rc 0) 00000100:00100000:0.0:1787733865.947391:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705719296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (6559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733865.947397:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787733865.947497:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705719296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733865.947529:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733865.947539:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733865.947609:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705719424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733865.947652:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733865.948677:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec50826c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733865.948753:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705719424 00000100:00100000:3.0:1787733865.948761:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705719424 00000100:00100000:3.0:1787733865.948798:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787733865.948806:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705719424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733865.949093:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705719424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.949101:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787733865.949717:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705719424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733865.949766:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705719552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787733865.949817:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733865.949837:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec50826c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733865.950044:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705719552 00000100:00100000:3.0:1787733865.950049:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705719552 00000100:00100000:3.0:1787733865.950075:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787733865.950082:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705719552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733865.953824:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705719552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3731us (3995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.953840:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787733865.954385:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705719552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733865.958731:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8487:1874574705719680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733865.958816:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733865.958865:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37600 going to sleep for 11 seconds 00000100:00100000:0.0:1787733865.959393:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705719680 00000100:00100000:0.0:1787733865.959401:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705719680 00000100:00100000:0.0:1787733865.959460:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787733865.959470:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:8487:x1874574705719680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733865.959770:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+12:8487:x1874574705719680:12345-0@lo:502:llog_process_th.0 Request processed in 301us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733865.959778:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787733865.959891:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8487:1874574705719680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787733865.959922:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787733865.959932:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733865.959934:0:8487:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787733865.959945:0:8487:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891ef0329800 00000020:00000080:3.0:1787733865.959953:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787733865.960042:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8487:1874574705719808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733865.960079:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733865.960095:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37600 going to sleep for 11 seconds 00000100:00100000:1.0:1787733865.962947:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705719808 00000100:00100000:1.0:1787733865.962961:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705719808 00000100:00100000:1.0:1787733865.963031:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787733865.963041:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:8487:x1874574705719808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787733865.963330:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:8487:x1874574705719808:12345-0@lo:502:llog_process_th.0 Request processed in 290us (3250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733865.963338:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787733865.963821:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8487:1874574705719808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787733865.963855:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787733865.963863:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733865.963865:0:8487:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787733865.963875:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787733865.964018:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787733865.964040:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787733865.964048:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.964059:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733865.964069:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787733865.964072:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891ec73ed000 from 39 10000000:01000000:1.0:1787733865.964075:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787733865.964104:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.964123:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.964133:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733865.964151:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705719936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787733865.964368:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.964404:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787733865.964636:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705719936 00000100:00100000:3.0:1787733865.964642:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705719936 00000100:00100000:3.0:1787733865.964685:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787733865.964693:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+12:5829:x1874574705719936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787733865.964704:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733865.964717:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891efe7eca00/0x45228d86de4d55da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d55d3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.964740:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891efe7eca00/0x45228d86de4d55da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d55d3 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.964763:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891efe7eca00/0x45228d86de4d55da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d55d3 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.964772:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7eca00, rc 0) 00000100:00100000:3.0:1787733865.964805:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705719936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.964811:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787733865.965195:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705719936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787733865.965209:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.965218:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733865.965275:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705720064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733865.965464:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733865.965574:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705720064 00000100:00100000:3.0:1787733865.965578:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705720064 00000100:00100000:3.0:1787733865.965615:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787733865.965622:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705720064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733865.965863:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705720064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.965870:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787733865.965918:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787733865.965931:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705720064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733865.965957:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705720192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733865.965993:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.966016:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787733865.966030:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705720192 00000100:00100000:1.0:1787733865.966033:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705720192 00000100:00100000:1.0:1787733865.966062:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787733865.966070:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705720192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733865.966363:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705720192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 293us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733865.966370:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787733865.966400:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705720192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787733865.981618:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8490:1874574705720320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733865.981701:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733865.981746:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705720320 00000100:00100000:0.0:1787733865.981753:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705720320 00000100:00100000:0.0:1787733865.981798:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787733865.981808:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:8490:x1874574705720320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733865.982060:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+13:8490:x1874574705720320:12345-0@lo:502:llog_process_th.0 Request processed in 252us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733865.982067:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787733865.982120:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec8589780 going to sleep for 11 seconds 00000100:00100000:0.0:1787733865.982140:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8490:1874574705720320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733865.982230:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8490:1874574705720448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733865.982261:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733865.982278:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787733865.989449:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705720448 00000100:00100000:3.0:1787733865.989467:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705720448 00000100:00100000:3.0:1787733865.990395:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787733865.990408:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:8490:x1874574705720448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733865.990766:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:8490:x1874574705720448:12345-0@lo:502:llog_process_th.0 Request processed in 361us (8503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733865.990774:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787733865.995721:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8490:1874574705720448:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787733865.995766:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787733865.996220:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787733865.996351:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787733865.996362:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.996373:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733865.996383:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787733865.996385:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787733865.996388:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787733865.996419:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.996427:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733865.996436:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733865.996457:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705720576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787733865.997411:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733865.997485:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787733865.997600:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705720576 00000100:00100000:3.0:1787733865.997608:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705720576 00000100:00100000:3.0:1787733865.997653:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787733865.997662:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+13:5829:x1874574705720576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787733865.997676:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733865.997691:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891efe7ecc00/0x45228d86de4d55e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d55e1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.997717:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891efe7ecc00/0x45228d86de4d55e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d55e1 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.997727:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891efe7ecc00/0x45228d86de4d55e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d55e1 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733865.997736:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ecc00, rc 0) 00000100:00100000:3.0:1787733866.004420:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705720576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6746us (6999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733866.004443:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787733866.005428:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705720576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787733866.005463:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733866.005497:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733866.006398:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705720704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787733866.006457:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733866.007190:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787733866.010830:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705720704 00000100:00100000:2.0:1787733866.010846:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705720704 00000100:00100000:2.0:1787733866.010950:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787733866.010961:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705720704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733866.012411:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705720704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1446us (5947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.012422:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787733866.012572:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705720704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733866.012627:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705720832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733866.012679:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733866.014751:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.014836:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705720832 00000100:00100000:3.0:1787733866.014845:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705720832 00000100:00100000:3.0:1787733866.014945:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787733866.014955:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705720832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.015224:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705720832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 271us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733866.016073:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705720832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.017446:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787733866.030004:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8496:1874574705720960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787733866.030387:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733866.030602:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082300 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.033811:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705720960 00000100:00100000:3.0:1787733866.033829:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705720960 00000100:00100000:2.0:1787733866.033944:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787733866.033955:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:8496:x1874574705720960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787733866.034259:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+14:8496:x1874574705720960:12345-0@lo:502:llog_process_th.0 Request processed in 305us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.034266:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787733866.034398:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8496:1874574705720960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787733866.034433:0:8496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787733866.034442:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733866.034449:0:8496:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787733866.034455:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787733866.034498:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8496:1874574705721088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787733866.034605:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733866.034636:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082300 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.034861:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705721088 00000100:00100000:3.0:1787733866.034867:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705721088 00000100:00100000:3.0:1787733866.034904:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787733866.034913:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:8496:x1874574705721088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733866.035069:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:8496:x1874574705721088:12345-0@lo:502:llog_process_th.0 Request processed in 157us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733866.035076:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787733866.035146:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8496:1874574705721088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787733866.035193:0:8496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787733866.035198:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787733866.035199:0:8496:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787733866.035205:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787733866.035606:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787733866.035627:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787733866.035637:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.035648:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733866.035658:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787733866.035660:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec73ed000 from 4 10000000:01000000:3.0:1787733866.035671:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787733866.035698:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.035707:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.035716:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733866.035732:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705721216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.035765:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733866.035788:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d376c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733866.035838:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705721216 00000100:00100000:2.0:1787733866.035843:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705721216 00000100:00100000:2.0:1787733866.035874:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787733866.035881:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+14:5829:x1874574705721216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733866.035891:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733866.035903:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13ca600/0x45228d86de4d55f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d55ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.035923:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13ca600/0x45228d86de4d55f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d55ef expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.035934:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13ca600/0x45228d86de4d55f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d55ef expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.035943:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca600, rc 0) 00000100:00100000:2.0:1787733866.035975:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705721216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.035981:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787733866.036049:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705721216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787733866.036061:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.036069:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733866.036110:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705721344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.036133:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733866.036172:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.036185:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705721344 00000100:00100000:3.0:1787733866.036188:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705721344 00000100:00100000:3.0:1787733866.036206:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787733866.036213:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705721344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.036448:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705721344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733866.036460:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787733866.036492:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705721344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.036645:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705721472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.036683:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733866.036692:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.036710:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705721472 00000100:00100000:3.0:1787733866.036713:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705721472 00000100:00100000:3.0:1787733866.036729:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787733866.036735:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705721472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.036860:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705721472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733866.036867:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787733866.036894:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705721472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787733866.041855:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8498:1874574705721600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787733866.041939:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733866.041989:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082300 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.042041:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705721600 00000100:00100000:3.0:1787733866.042049:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705721600 00000100:00100000:3.0:1787733866.042097:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787733866.042107:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+15:8498:x1874574705721600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733866.042369:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+15:8498:x1874574705721600:12345-0@lo:502:llog_process_th.0 Request processed in 262us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733866.042377:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787733866.042706:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8498:1874574705721600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787733866.042734:0:8498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787733866.042748:0:8498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733866.042750:0:8498:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787733866.042757:0:8498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891ec73ed000 00000020:00000080:2.0:1787733866.042759:0:8498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787733866.042844:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8498:1874574705721728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787733866.042878:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733866.042893:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082300 going to sleep for 11 seconds 00000100:00100000:2.0:1787733866.043209:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705721728 00000100:00100000:2.0:1787733866.043215:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705721728 00000100:00100000:2.0:1787733866.043254:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787733866.043262:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:8498:x1874574705721728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787733866.043609:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+15:8498:x1874574705721728:12345-0@lo:502:llog_process_th.0 Request processed in 347us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.043617:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787733866.043658:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8498:1874574705721728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787733866.043677:0:8498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787733866.043683:0:8498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787733866.043685:0:8498:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787733866.043688:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787733866.047034:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787733866.047071:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787733866.047083:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.047107:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733866.047118:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787733866.047121:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891ec7b73800 from 39 10000000:01000000:3.0:1787733866.047124:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787733866.047186:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.047194:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.047203:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733866.047227:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705721856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.048450:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733866.049571:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787733866.049678:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705721856 00000100:00100000:2.0:1787733866.049687:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705721856 00000100:00100000:2.0:1787733866.049746:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787733866.049758:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+15:5829:x1874574705721856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733866.049774:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733866.049792:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13cac00/0x45228d86de4d5604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d55fd expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.049820:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13cac00/0x45228d86de4d5604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d55fd expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.049841:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13cac00/0x45228d86de4d5604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d55fd expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.049851:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cac00, rc 0) 00000100:00100000:2.0:1787733866.049911:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705721856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.049919:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787733866.050003:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705721856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787733866.050019:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.050028:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733866.050095:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705721984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.050124:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733866.050191:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.050206:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705721984 00000100:00100000:3.0:1787733866.050209:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705721984 00000100:00100000:3.0:1787733866.050230:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787733866.050236:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705721984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.052683:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705721984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2440us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733866.052696:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787733866.052857:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705721984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733866.052907:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705722112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787733866.052956:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733866.052992:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082600 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.060616:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705722112 00000100:00100000:3.0:1787733866.060634:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705722112 00000100:00100000:3.0:1787733866.060706:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787733866.060717:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705722112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.060981:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705722112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (8023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733866.060988:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787733866.062251:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705722112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733866.067630:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe938700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8502:1874574705722240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787733866.067718:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733866.067755:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787733866.077300:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705722240 00000100:00100000:1.0:1787733866.077314:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705722240 00000100:00100000:1.0:1787733866.077372:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787733866.077382:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:8502:x1874574705722240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787733866.077707:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:8502:x1874574705722240:12345-0@lo:502:llog_process_th.0 Request processed in 325us (9988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733866.077715:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787733866.077813:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe938700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8502:1874574705722240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733866.077879:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8502:1874574705722368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733866.077923:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733866.077994:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2540 going to sleep for 11 seconds 00000100:00100000:1.0:1787733866.078024:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705722368 00000100:00100000:1.0:1787733866.078029:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705722368 00000100:00100000:1.0:1787733866.078088:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787733866.078096:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:8502:x1874574705722368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787733866.078334:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:8502:x1874574705722368:12345-0@lo:502:llog_process_th.0 Request processed in 239us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733866.078347:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787733866.078425:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8502:1874574705722368:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787733866.078445:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787733866.079780:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787733866.079810:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787733866.079821:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733866.079834:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733866.079845:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787733866.079848:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787733866.079851:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787733866.079883:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733866.079906:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733866.079916:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733866.079938:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705722496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787733866.079991:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733866.080025:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787733866.080042:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705722496 00000100:00100000:0.0:1787733866.080048:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705722496 00000100:00100000:0.0:1787733866.080091:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787733866.080100:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705722496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787733866.080112:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733866.080125:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6658c00/0x45228d86de4d5612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d560b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733866.080147:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6658c00/0x45228d86de4d5612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d560b expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733866.080187:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6658c00/0x45228d86de4d5612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d560b expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733866.080196:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658c00, rc 0) 00000100:00100000:0.0:1787733866.080248:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705722496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733866.080254:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787733866.080299:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705722496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787733866.080313:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733866.080322:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733866.080370:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705722624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787733866.080396:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733866.080410:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787733866.080423:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705722624 00000100:00100000:0.0:1787733866.080427:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705722624 00000100:00100000:0.0:1787733866.080448:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787733866.080454:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705722624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787733866.080704:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705722624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733866.080711:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787733866.080739:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705722624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787733866.080765:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705722752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787733866.080801:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733866.080815:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc76d2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787733866.080827:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705722752 00000100:00100000:0.0:1787733866.080830:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705722752 00000100:00100000:0.0:1787733866.080850:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787733866.080857:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705722752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787733866.080991:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705722752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733866.081005:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787733866.081041:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705722752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.088063:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8503:1874574705722880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733866.088183:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733866.088228:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6e01c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787733866.088253:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705722880 00000100:00100000:0.0:1787733866.088419:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705722880 00000100:00100000:0.0:1787733866.088468:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787733866.088488:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:8503:x1874574705722880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733866.088817:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:8503:x1874574705722880:12345-0@lo:502:llog_process_th.0 Request processed in 341us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733866.088825:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787733866.089091:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8503:1874574705722880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787733866.089124:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787733866.089133:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733866.089135:0:8503:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787733866.089146:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787733866.090576:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8503:1874574705723008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733866.090662:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733866.091247:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705723008 00000100:00100000:2.0:1787733866.091255:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705723008 00000100:00100000:2.0:1787733866.091372:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787733866.091381:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+17:8503:x1874574705723008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733866.091430:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6e01c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787733866.091663:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+17:8503:x1874574705723008:12345-0@lo:502:llog_process_th.0 Request processed in 282us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.091671:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787733866.092453:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8503:1874574705723008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787733866.092517:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787733866.092525:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733866.092527:0:8503:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787733866.092544:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787733866.092633:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787733866.092669:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787733866.092680:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733866.092691:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733866.092700:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787733866.092703:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec7b73800 from 4 10000000:01000000:1.0:1787733866.092706:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787733866.092734:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733866.092742:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733866.092751:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733866.092770:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe93b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705723136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787733866.092812:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733866.092854:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8528cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.095748:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705723136 00000100:00100000:3.0:1787733866.095762:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705723136 00000100:00100000:3.0:1787733866.095812:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787733866.095819:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705723136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787733866.095834:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733866.095850:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891efe7ed600/0x45228d86de4d5620 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5619 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.095872:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891efe7ed600/0x45228d86de4d5620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5619 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.095881:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891efe7ed600/0x45228d86de4d5620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5619 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.095888:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ed600, rc 0) 00000100:00100000:3.0:1787733866.095965:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705723136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (3152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733866.095971:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787733866.096025:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe93b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705723136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787733866.096043:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733866.096209:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733866.096278:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705723264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.096304:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733866.096327:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6e01480 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.096338:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705723264 00000100:00100000:3.0:1787733866.096341:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705723264 00000100:00100000:3.0:1787733866.096367:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787733866.096376:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705723264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.096661:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705723264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733866.096675:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787733866.096707:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705723264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.096738:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705723392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.096776:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733866.096803:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6e01480 going to sleep for 11 seconds 00000100:00100000:2.0:1787733866.097134:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705723392 00000100:00100000:2.0:1787733866.097139:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705723392 00000100:00100000:2.0:1787733866.097186:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787733866.097197:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705723392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787733866.097368:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705723392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.097381:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787733866.097390:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705723392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733866.097822:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8505:1874574705723520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733866.097859:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733866.097913:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec28d3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787733866.097947:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705723520 00000100:00100000:2.0:1787733866.097952:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705723520 00000100:00100000:2.0:1787733866.098013:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787733866.098022:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+18:8505:x1874574705723520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787733866.098252:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+18:8505:x1874574705723520:12345-0@lo:502:llog_process_th.0 Request processed in 233us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.098259:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787733866.098660:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8505:1874574705723520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787733866.098758:0:8505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787733866.098768:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733866.098770:0:8505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787733866.098782:0:8505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891ec7b73800 00000020:00000080:3.0:1787733866.098792:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787733866.098872:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8505:1874574705723648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733866.098908:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733866.098941:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec28d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787733866.099250:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705723648 00000100:00100000:3.0:1787733866.099256:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705723648 00000100:00100000:3.0:1787733866.099286:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787733866.099294:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:8505:x1874574705723648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733866.099469:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:8505:x1874574705723648:12345-0@lo:502:llog_process_th.0 Request processed in 175us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733866.099488:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787733866.100232:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:8505:1874574705723648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787733866.100268:0:8505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787733866.100275:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733866.100277:0:8505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787733866.100290:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787733866.101559:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787733866.101589:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787733866.101600:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.101613:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787733866.101624:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787733866.101627:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff891ef03219b8 from 1 10000000:01000000:2.0:1787733866.101629:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787733866.101662:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13cb400/0x45228d86de4d5627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.101676:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec13cb400/0x45228d86de4d5627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.101695:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec13cb400/0x45228d86de4d5627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733866.101717:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705723776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787733866.101779:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733866.101808:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082480 going to sleep for 11 seconds 00000100:00100000:2.0:1787733866.101832:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705723776 00000100:00100000:2.0:1787733866.101838:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705723776 00000100:00100000:2.0:1787733866.101879:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787733866.101887:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705723776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733866.101899:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733866.101924:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13cb200/0x45228d86de4d562e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5627 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.101948:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13cb200/0x45228d86de4d562e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5627 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.101958:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13cb200/0x45228d86de4d562e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5627 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.101968:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cb200, rc 0) 00000100:00100000:2.0:1787733866.102017:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705723776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.102024:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787733866.102077:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705723776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733866.102090:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec13cb400/0x45228d86de4d5627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d562e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.102099:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec13cb400/0x45228d86de4d5627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d562e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733866.102146:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705723904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733866.102198:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733866.102213:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082480 going to sleep for 11 seconds 00000100:00100000:2.0:1787733866.102226:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705723904 00000100:00100000:2.0:1787733866.102229:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705723904 00000100:00100000:2.0:1787733866.102251:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787733866.102257:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705723904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733866.102522:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705723904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (321us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787733866.102530:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787733866.102586:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705723904:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787733866.102609:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787733866.102615:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13cb400/0x45228d86de4d5627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d562e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733866.102621:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec13cb400/0x45228d86de4d5627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d562e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733866.298523:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705724032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787733866.298602:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733866.298777:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705724032 00000100:00100000:2.0:1787733866.298785:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705724032 00000100:00100000:2.0:1787733866.298844:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787733866.298855:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705724032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787733866.298891:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733866.298952:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705724032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.298960:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787733866.299048:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59d880 x1874574705724032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733866.299068:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705724032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787733866.612785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733866.612824:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733866.612863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733866.613068:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689965440 00000100:00100000:0.0:1787733866.613080:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689965440 00000100:00080000:1.0:1787733866.613128:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787733866.613147:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689965568 00000100:00100000:0.0:1787733866.613151:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689965568 00000100:00080000:1.0:1787733866.613449:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787733866.613449:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787733866.613461:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689965440:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733866.613542:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689965440:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 84us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733866.613550:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787733866.613566:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1787733866.613572:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689965568:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733866.613594:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689965568:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733866.613600:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1787733866.614824:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689965312 00000100:00100000:2.0:1787733866.614831:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689965312 00000100:00100000:2.0:1787733866.614876:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1787733866.614886:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689965312:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733866.614937:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689965312:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 53us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733866.614943:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00080000:1.0:1787733866.615045:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787733866.945687:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733867.191684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733867.193762:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689965696 00000100:00100000:2.0:1787733867.193776:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689965696 00000100:00100000:2.0:1787733867.193843:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 185 00000100:00100000:2.0:1787733867.193855:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:5593:x1874574689965696:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733867.193873:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733867.193890:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13caa00/0x45228d86de4d5635 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df1934e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733867.193915:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13caa00/0x45228d86de4d5635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1934e expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733867.193923:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13caa00/0x45228d86de4d5635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1934e expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733867.193938:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13caa00, rc 0) 00000100:00100000:2.0:1787733867.194057:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5593:x1874574689965696:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 203us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733867.194064:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 185 00000100:00100000:2.0:1787733867.204800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733867.204883:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689965824 00000100:00100000:0.0:1787733867.204897:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689965824 00000100:00100000:0.0:1787733867.206074:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 186 00000100:00100000:0.0:1787733867.206088:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5593:x1874574689965824:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787733867.206397:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5593:x1874574689965824:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 311us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733867.206405:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 186 00000100:00100000:0.0:1787733867.217113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733867.217208:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689965952 00000100:00100000:3.0:1787733867.217219:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689965952 00000100:00100000:3.0:1787733867.217562:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00100000:3.0:1787733867.217573:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5593:x1874574689965952:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733867.218137:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:5593:x1874574689965952:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 564us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733867.218147:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00100000:2.0:1787733867.229505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733867.238408:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689966080 00000100:00100000:3.0:1787733867.238424:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689966080 00000100:00100000:3.0:1787733867.238496:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:3.0:1787733867.238507:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:6120:x1874574689966080:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787733867.238886:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:6120:x1874574689966080:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 380us (9393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733867.238896:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:3.0:1787733867.242586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733867.242622:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689966208 00000100:00100000:3.0:1787733867.242631:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689966208 00000100:00100000:3.0:1787733867.242681:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:3.0:1787733867.242691:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:6120:x1874574689966208:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787733867.243511:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:6120:x1874574689966208:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 817us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733867.243521:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 189 00010000:00010000:3.0:1787733867.964094:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733868.987392:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733870.011945:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733870.401623:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705724160:0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.401700:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733870.401760:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705724672:0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.401787:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733870.401816:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787733870.401822:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705724288:0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.401845:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733870.401862:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705724800:0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.401885:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733870.401913:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705724416:0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.401937:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733870.401956:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787733870.401962:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705724544:0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.401983:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733870.402014:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705724672 00000100:00100000:2.0:1787733870.402022:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705724672 00000100:00100000:2.0:1787733870.402075:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705724288 00000100:00100000:2.0:1787733870.402079:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705724288 00000100:00100000:2.0:1787733870.402091:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705724416 00000100:00100000:2.0:1787733870.402093:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705724416 00000100:00100000:2.0:1787733870.402112:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787733870.402120:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705724672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.402202:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705724672:12345-0@lo:400:kworker.0 Request processed in 82us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733870.402209:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787733870.402226:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787733870.402247:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705724288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.402277:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705724288:12345-0@lo:400:kworker.0 Request processed in 31us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733870.402283:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787733870.402296:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787733870.402303:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705724416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.402334:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705724416:12345-0@lo:400:kworker.0 Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733870.402340:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787733870.402362:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705724800 00000100:00100000:2.0:1787733870.402365:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705724800 00000100:00100000:2.0:1787733870.402391:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705724544 00000100:00100000:2.0:1787733870.402394:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705724544 00000100:00100000:2.0:1787733870.402429:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787733870.402435:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705724800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.402466:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705724800:12345-0@lo:400:kworker.0 Request processed in 31us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733870.402472:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787733870.402483:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787733870.402488:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705724544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.402514:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705724544:12345-0@lo:400:kworker.0 Request processed in 26us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733870.402519:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787733870.402539:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733870.402543:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787733870.402546:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733870.402576:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705724288:0@lo:400:kworker.0 00010000:00080000:2.0:1787733870.402598:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59f480 x1874574705724800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733870.402608:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705724800:0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.402619:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705724672:0@lo:400:kworker.0 00010000:00080000:2.0:1787733870.402648:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59ce00 x1874574705724544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733870.402657:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705724544:0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.402667:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705724416:0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.402724:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705724160 00000100:00100000:2.0:1787733870.402728:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705724160 00000100:00100000:2.0:1787733870.402753:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787733870.402760:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705724160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.402794:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705724160:12345-0@lo:400:kworker.0 Request processed in 34us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733870.402800:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787733870.402832:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705724160:0@lo:400:kworker.0 00000100:00100000:2.0:1787733870.908069:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705724928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787733870.908147:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733870.908249:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705724928 00000100:00100000:2.0:1787733870.908256:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705724928 00000100:00100000:2.0:1787733870.909380:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787733870.909408:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705724928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787733870.909451:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733870.909523:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705724928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733870.909530:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787733870.909999:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59fb80 x1874574705724928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733870.910021:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705724928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787733871.035030:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733871.419325:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705725056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787733871.419403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733871.419611:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705725056 00000100:00100000:2.0:1787733871.419620:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705725056 00000100:00100000:2.0:1787733871.419667:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787733871.419677:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705725056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787733871.419711:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1787733871.419892:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59ce00 x1874574705725056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733871.419918:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705725056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 240us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733871.419926:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787733871.420006:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705725056:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787733871.717392:0:8789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1787733871.743933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733871.744015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733871.744051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733871.744079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733871.744107:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689966464 00000100:00100000:2.0:1787733871.744117:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689966464 00000100:00100000:2.0:1787733871.744219:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1787733871.744231:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689966464:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733871.744308:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689966464:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733871.744316:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1787733871.744339:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689966592 00000100:00100000:2.0:1787733871.744343:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689966592 00000100:00100000:2.0:1787733871.744368:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689966720 00000100:00100000:2.0:1787733871.744371:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689966720 00000100:00100000:2.0:1787733871.744405:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1787733871.744433:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689966592:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733871.744479:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689966592:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 67us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733871.744487:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1787733871.744500:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1787733871.744507:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689966720:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733871.744530:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689966720:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733871.744536:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00080000:2.0:1787733871.744552:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787733871.744556:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733871.744558:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733871.748445:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689966336 00000100:00100000:3.0:1787733871.748462:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689966336 00000100:00100000:3.0:1787733871.748528:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:3.0:1787733871.748538:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2355:x1874574689966336:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733871.751111:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2355:x1874574689966336:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 2559us (7176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733871.751126:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 191 00010000:00010000:2.0:1787733872.061769:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733873.085109:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733874.107026:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733875.131018:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733875.515484:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705725312:0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.515558:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733875.515610:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705725824:0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.515636:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733875.515670:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787733875.515677:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705725184:0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.515811:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733875.515966:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705725696:0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.515991:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733875.516025:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705725440:0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.516047:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733875.516062:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787733875.516068:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705725568:0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.516087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733875.516114:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705725312 00000100:00100000:3.0:1787733875.516121:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705725312 00000100:00100000:3.0:1787733875.516184:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705725696 00000100:00100000:3.0:1787733875.516198:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705725696 00000100:00100000:3.0:1787733875.516223:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705725440 00000100:00100000:3.0:1787733875.516225:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705725440 00000100:00100000:3.0:1787733875.516241:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787733875.516249:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705725312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.516381:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705725312:12345-0@lo:400:kworker.0 Request processed in 132us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733875.516389:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787733875.516405:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787733875.516411:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705725696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.516436:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705725696:12345-0@lo:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733875.516441:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787733875.516449:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787733875.516454:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705725440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.516477:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705725440:12345-0@lo:400:kworker.0 Request processed in 23us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733875.516482:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787733875.516498:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705725824 00000100:00100000:3.0:1787733875.516502:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705725824 00000100:00100000:3.0:1787733875.516523:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705725568 00000100:00100000:3.0:1787733875.516526:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705725568 00000100:00100000:3.0:1787733875.516541:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787733875.516547:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705725824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.516575:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705725824:12345-0@lo:400:kworker.0 Request processed in 28us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733875.516580:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787733875.516598:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787733875.516604:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705725568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.516631:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705725568:12345-0@lo:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733875.516636:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787733875.516668:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efea9ea00 x1874574705725568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733875.516683:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705725568:0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.516694:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705725440:0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.516809:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705725696:0@lo:400:kworker.0 00000100:00100000:3.0:1787733875.516820:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705725312:0@lo:400:kworker.0 00010000:00080000:3.0:1787733875.516830:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efea9ce00 x1874574705725824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733875.516839:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705725824:0@lo:400:kworker.0 00000100:00100000:2.0:1787733875.520080:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705725184 00000100:00100000:2.0:1787733875.520097:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705725184 00000100:00100000:2.0:1787733875.520173:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787733875.520185:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705725184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733875.520285:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705725184:12345-0@lo:400:kworker.0 Request processed in 103us (4473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733875.520428:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705725184:0@lo:400:kworker.0 00000100:00100000:2.0:1787733875.520899:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:2.0:1787733875.521131:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733875.521136:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787733875.521140:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787733875.950079:0:9033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing yml_node 00000100:00100000:3.0:1787733876.033537:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705725952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787733876.033624:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733876.033832:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705725952 00000100:00100000:1.0:1787733876.033840:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705725952 00000100:00100000:1.0:1787733876.033897:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787733876.033907:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705725952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787733876.033946:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733876.033996:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705725952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733876.034002:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787733876.034075:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe939500 x1874574705725952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733876.034095:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705725952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787733876.154402:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733876.538363:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733876.538389:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705726080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787733876.538468:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733876.538568:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705726080 00000100:00100000:2.0:1787733876.538577:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705726080 00000100:00100000:2.0:1787733876.538631:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787733876.538642:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705726080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787733876.538795:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733876.538900:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705726080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733876.538908:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787733876.542859:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe93aa00 x1874574705726080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733876.542890:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705726080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787733876.853955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733876.853994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733876.854029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733876.854100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733876.854126:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689966976 00000100:00100000:3.0:1787733876.854134:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689966976 00000100:00100000:3.0:1787733876.854270:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1787733876.854280:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2356:x1874574689966976:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733876.854367:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2356:x1874574689966976:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 89us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733876.854375:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1787733876.854398:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689967104 00000100:00100000:3.0:1787733876.854401:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689967104 00000100:00100000:3.0:1787733876.854420:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689967232 00000100:00100000:3.0:1787733876.854422:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689967232 00000100:00100000:3.0:1787733876.854437:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:3.0:1787733876.854443:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2357:x1874574689967104:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733876.854464:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2357:x1874574689967104:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 22us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733876.854470:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:3.0:1787733876.854479:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:3.0:1787733876.854484:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574689967232:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733876.854500:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574689967232:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 17us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733876.854506:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00080000:2.0:1787733876.854570:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787733876.854575:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733876.854578:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733876.854820:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689966848 00000100:00100000:1.0:1787733876.854825:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689966848 00000100:00100000:1.0:1787733876.854858:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:1.0:1787733876.854864:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2357:x1874574689966848:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733876.854901:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2357:x1874574689966848:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733876.854907:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 193 00010000:00010000:0.0:1787733877.178665:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733878.203021:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733879.227254:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787733879.867429:0:9224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00010000:00010000:0.0:1787733880.251144:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733880.636364:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705726208:0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.636442:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733880.636451:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705726592:0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.636485:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705726720:0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.636510:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733880.636535:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787733880.636542:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705726336:0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.636657:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733880.636675:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705726848:0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.636698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733880.636728:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705726208 00000100:00100000:3.0:1787733880.636730:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733880.636736:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705726208 00000100:00100000:3.0:1787733880.636753:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787733880.636758:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705726464:0@lo:400:kworker.0 00000100:00100000:3.0:1787733880.636781:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733880.636806:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705726848 00000100:00100000:3.0:1787733880.636810:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705726848 00000100:00100000:3.0:1787733880.636856:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705726592 00000100:00100000:3.0:1787733880.636859:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705726592 00000100:00100000:3.0:1787733880.636882:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787733880.636892:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705726848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.636918:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787733880.636924:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705726208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733880.636943:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705726848:12345-0@lo:400:kworker.0 Request processed in 53us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733880.636950:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787733880.636952:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705726208:12345-0@lo:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733880.636957:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787733880.636966:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787733880.636972:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705726592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.636983:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705726720 00000100:00100000:2.0:1787733880.636986:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705726720 00000100:00100000:3.0:1787733880.636999:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705726592:12345-0@lo:400:kworker.0 Request processed in 28us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733880.637005:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787733880.637009:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705726336 00000100:00100000:2.0:1787733880.637018:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705726336 00000100:00100000:3.0:1787733880.637023:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705726464 00000100:00100000:3.0:1787733880.637026:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705726464 00000100:00100000:2.0:1787733880.637034:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787733880.638150:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787733880.639806:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705726720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.639902:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705726720:12345-0@lo:400:kworker.0 Request processed in 2861us (3391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733880.639913:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787733880.639944:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787733880.639953:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705726464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.639990:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705726464:12345-0@lo:400:kworker.0 Request processed in 39us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733880.639995:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787733880.640061:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787733880.640067:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733880.640071:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787733880.640395:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705726464:0@lo:400:kworker.0 00010000:00080000:2.0:1787733880.640413:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6ef2a00 x1874574705726592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733880.640425:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705726592:0@lo:400:kworker.0 00010000:00080000:2.0:1787733880.640467:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6ef0e00 x1874574705726848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733880.640477:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705726848:0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.640488:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705726208:0@lo:400:kworker.0 00000100:00100000:2.0:1787733880.640498:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705726720:0@lo:400:kworker.0 00000100:00100000:3.0:1787733880.644168:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705726336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733880.644294:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705726336:12345-0@lo:400:kworker.0 Request processed in 6123us (7635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733880.644306:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787733880.644437:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705726336:0@lo:400:kworker.0 00000100:00100000:2.0:1787733881.146487:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705726976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787733881.146568:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733881.146786:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705726976 00000100:00100000:3.0:1787733881.146796:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705726976 00000100:00100000:3.0:1787733881.146861:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787733881.146870:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705726976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787733881.146911:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733881.146961:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705726976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733881.146968:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787733881.147006:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe93aa00 x1874574705726976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733881.153655:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705726976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787733881.275014:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733881.660770:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787733881.660797:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705727104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733881.660874:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733881.661236:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705727104 00000100:00100000:1.0:1787733881.661245:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705727104 00000100:00100000:1.0:1787733881.661301:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787733881.661312:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705727104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787733881.661349:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733881.661409:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705727104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733881.661417:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787733881.661472:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe938e00 x1874574705727104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733881.661492:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705727104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787733881.972270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733881.972314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733881.972392:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689967360 00000100:00100000:2.0:1787733881.972403:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689967360 00000100:00100000:2.0:1787733881.972460:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:2.0:1787733881.972473:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2354:x1874574689967360:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733881.972551:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2354:x1874574689967360:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 80us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733881.972559:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:0.0:1787733881.972815:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689967488 00000100:00100000:0.0:1787733881.972820:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689967488 00000100:00100000:0.0:1787733881.972879:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1787733881.972888:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689967488:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733881.972966:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689967488:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 79us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733881.972987:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00080000:2.0:1787733881.973044:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787733881.981474:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733881.981521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733881.981613:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689967616 00000100:00100000:2.0:1787733881.981636:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689967616 00000100:00100000:2.0:1787733881.981714:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689967744 00000100:00100000:2.0:1787733881.981717:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689967744 00000100:00100000:2.0:1787733881.981745:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1787733881.981757:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2353:x1874574689967616:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:2.0:1787733881.981796:0:6729:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5571 00000100:00080000:2.0:1787733881.981807:0:6729:0:(import.c:65:import_set_state_nolock()) ffff891ec6c82000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787733881.981845:0:6729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1787733881.982229:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787733881.982234:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787733881.982476:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+2:2353:x1874574689967616:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 719us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733881.982485:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1787733881.982504:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1787733881.982512:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2353:x1874574689967744:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:2.0:1787733881.982527:0:6729:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5578 00000100:00080000:2.0:1787733881.982533:0:6729:0:(import.c:65:import_set_state_nolock()) ffff891efe96a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787733881.982567:0:6729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787733881.982780:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+2:2353:x1874574689967744:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 267us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733881.982787:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00010000:00010000:2.0:1787733881.982856:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733881.982862:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787733882.190922:0:9323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00010000:00010000:2.0:1787733882.298285:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787733883.272864:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000020:00000080:0.0:1787733883.272876:0:6705:0:(genops.c:885:class_export_put()) final put ffff891ec73ee800/a2c26bfa-a021-441a-9db5-0c3742b5640d 00000020:00000080:1.0:1787733883.272944:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec73ee800/a2c26bfa-a021-441a-9db5-0c3742b5640d for lustre-OST0000 00000020:00000080:1.0:1787733883.273003:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ec6c82000 for lustre-OST0000 00010000:00010000:3.0:1787733883.322406:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733884.346255:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787733885.000052:0:9421:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:3.0:1787733885.370946:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733885.754507:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705727360:0@lo:400:kworker.0 00000100:00100000:0.0:1787733885.754710:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733885.754796:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705727616:0@lo:400:kworker.0 00000100:00100000:2.0:1787733885.754827:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733885.754859:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787733885.754865:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705727488:0@lo:400:kworker.0 00000100:00100000:0.0:1787733885.754865:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705727872:0@lo:400:kworker.0 00000100:00100000:2.0:1787733885.754887:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733885.754887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733885.754903:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787733885.754908:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705727232:0@lo:400:kworker.0 00000100:00100000:2.0:1787733885.754914:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705727360 00000100:00100000:2.0:1787733885.754920:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705727360 00000100:00100000:0.0:1787733885.754931:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733885.754960:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705727488 00000100:00100000:2.0:1787733885.754963:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705727488 00000100:00100000:0.0:1787733885.754964:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705727744:0@lo:400:kworker.0 00000100:00100000:0.0:1787733885.754983:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733885.754987:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705727744 00000100:00100000:2.0:1787733885.754990:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705727744 00000100:00100000:2.0:1787733885.755007:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787733885.755016:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705727360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733885.755018:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705727232 00000100:00100000:0.0:1787733885.755021:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705727232 00000100:00100000:0.0:1787733885.755047:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787733885.755053:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705727232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733885.755079:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705727360:12345-0@lo:400:kworker.0 Request processed in 63us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733885.755079:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705727232:12345-0@lo:400:kworker.0 Request processed in 25us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733885.755086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787733885.755086:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787733885.755101:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787733885.755106:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705727488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733885.755147:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705727488:12345-0@lo:400:kworker.0 Request processed in 40us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733885.755150:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705727616 00000100:00100000:2.0:1787733885.755186:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787733885.755192:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705727616 00000100:00100000:2.0:1787733885.755198:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787733885.755203:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705727744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733885.755222:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705727872 00000100:00100000:0.0:1787733885.755225:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705727872 00000100:00100000:2.0:1787733885.755231:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705727744:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733885.755237:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787733885.755254:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787733885.755259:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733885.755261:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733885.755300:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705727488:0@lo:400:kworker.0 00000100:00100000:0.0:1787733885.755414:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787733885.755422:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705727616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733885.755456:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705727616:12345-0@lo:400:kworker.0 Request processed in 35us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733885.755461:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787733885.755473:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787733885.755479:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705727872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733885.755505:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705727872:12345-0@lo:400:kworker.0 Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733885.755511:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787733885.755700:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705727232:0@lo:400:kworker.0 00000100:00100000:0.0:1787733885.755711:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705727744:0@lo:400:kworker.0 00000100:00100000:0.0:1787733885.755718:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705727360:0@lo:400:kworker.0 00010000:00080000:0.0:1787733885.755729:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6d9df80 x1874574705727872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733885.755738:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705727872:0@lo:400:kworker.0 00010000:00080000:2.0:1787733885.756423:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6d9e300 x1874574705727616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733885.756434:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705727616:0@lo:400:kworker.0 00000001:00100000:0.0:1787733885.808750:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000020:00000080:0.0:1787733885.808762:0:7629:0:(genops.c:885:class_export_put()) final put ffff891efe969000/a2c26bfa-a021-441a-9db5-0c3742b5640d 00000020:00000080:3.0:1787733885.808841:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891efe969000/a2c26bfa-a021-441a-9db5-0c3742b5640d for lustre-OST0001 00000020:00000080:3.0:1787733885.808896:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891efe96a800 for lustre-OST0001 00000100:00100000:3.0:1787733886.270901:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787733886.270923:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705728000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787733886.271000:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733886.271054:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705728000 00000100:00100000:0.0:1787733886.271063:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705728000 00000100:00100000:0.0:1787733886.271119:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787733886.271138:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705728000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787733886.271207:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787733886.271256:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705728000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733886.271264:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787733886.271313:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efea9c700 x1874574705728000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733886.271331:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705728000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787733886.395435:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787733886.770889:0:9471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 04:44:45 EDT 2026 00000100:00100000:2.0:1787733886.778437:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787733886.778463:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705728128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787733886.778537:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733886.778658:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705728128 00000100:00100000:1.0:1787733886.778666:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705728128 00000100:00100000:1.0:1787733886.778720:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787733886.778730:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705728128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787733886.778764:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733886.778815:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705728128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733886.778823:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787733886.778860:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe938e00 x1874574705728128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733886.778878:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705728128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733887.093373:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733887.093471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733887.094324:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689967872 00000100:00100000:3.0:1787733887.094334:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689967872 00000100:00100000:3.0:1787733887.094394:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 197 00000100:00100000:3.0:1787733887.094405:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2354:x1874574689967872:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733887.094488:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2354:x1874574689967872:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 83us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733887.094496:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 197 00000100:00100000:2.0:1787733887.097347:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689968000 00000100:00100000:2.0:1787733887.097360:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689968000 00000100:00100000:2.0:1787733887.097489:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:2.0:1787733887.097502:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574689968000:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733887.097584:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574689968000:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 85us (4223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733887.097592:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00080000:0.0:1787733887.097766:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787733887.419312:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733888.442380:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733889.468091:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733890.490655:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733890.875029:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705728384:0@lo:400:kworker.0 00000100:00100000:3.0:1787733890.875369:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefdaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705728640:0@lo:400:kworker.0 00000100:00100000:3.0:1787733890.875400:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733890.875461:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787733890.875468:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705728512:0@lo:400:kworker.0 00000100:00100000:3.0:1787733890.875513:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705728640 00000100:00100000:3.0:1787733890.875592:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705728640 00000100:00100000:3.0:1787733890.875666:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787733890.875679:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705728640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733890.875753:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705728640:12345-0@lo:400:kworker.0 Request processed in 76us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733890.875761:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787733890.875785:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787733890.875834:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733890.875864:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefda8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705728896:0@lo:400:kworker.0 00000100:00100000:0.0:1787733890.875889:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733890.875911:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787733890.875920:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705728256:0@lo:400:kworker.0 00000100:00100000:2.0:1787733890.875944:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705728896 00000100:00100000:2.0:1787733890.875948:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705728896 00000100:00100000:0.0:1787733890.875961:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733890.875984:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787733890.875992:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705728896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733890.875994:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefda9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705728768:0@lo:400:kworker.0 00000100:00100000:2.0:1787733890.876030:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705728896:12345-0@lo:400:kworker.0 Request processed in 39us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733890.876034:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787733890.876051:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733890.876065:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705728256 00000100:00100000:2.0:1787733890.876073:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705728256 00010000:00080000:0.0:1787733890.876086:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eefda8700 x1874574705728896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733890.876101:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefda8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705728896:0@lo:400:kworker.0 00000100:00100000:2.0:1787733890.876104:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787733890.876115:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705728256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733890.876145:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705728256:12345-0@lo:400:kworker.0 Request processed in 33us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733890.876151:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1787733890.876199:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787733890.877262:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705728384 00000100:00100000:3.0:1787733890.877269:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705728384 00000100:00100000:3.0:1787733890.877306:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705728768 00000100:00100000:3.0:1787733890.877308:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705728768 00000100:00100000:2.0:1787733890.877470:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787733890.877472:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705728256:0@lo:400:kworker.0 00000100:00100000:2.0:1787733890.877484:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefdab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705728384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733890.877585:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787733890.877594:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefdaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705728768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733890.877668:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705728384:0@lo:400:kworker.0 00000100:00100000:2.0:1787733890.877692:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefdab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705728384:12345-0@lo:400:kworker.0 Request processed in 211us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733890.877703:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787733890.877705:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefdaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705728768:12345-0@lo:400:kworker.0 Request processed in 109us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733890.877712:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787733890.877741:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733890.877765:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787733890.877803:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eefdaa680 x1874574705728640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733890.877813:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefdaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705728640:0@lo:400:kworker.0 00000100:00100000:2.0:1787733890.877900:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705728512 00000100:00100000:2.0:1787733890.877905:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705728512 00000100:00100000:0.0:1787733890.877938:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefda9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705728768:0@lo:400:kworker.0 00000100:00080000:3.0:1787733890.878038:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733890.878067:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787733890.878084:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705728512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733890.878123:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705728512:12345-0@lo:400:kworker.0 Request processed in 42us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733890.878130:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787733890.879050:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705728512:0@lo:400:kworker.0 00000100:00100000:1.0:1787733891.386497:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705729024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787733891.386578:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733891.386707:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705729024 00000100:00100000:3.0:1787733891.386714:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705729024 00000100:00100000:3.0:1787733891.386770:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787733891.386781:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705729024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787733891.386829:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733891.386881:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705729024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733891.386887:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787733891.386924:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efea9fb80 x1874574705729024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733891.386944:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705729024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787733891.514365:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733891.898446:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705729152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787733891.898568:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733891.898693:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705729152 00000100:00100000:3.0:1787733891.898705:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705729152 00000100:00100000:3.0:1787733891.898766:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787733891.898781:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705729152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787733891.898844:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733891.898891:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705729152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733891.898898:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787733891.898958:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efea9fb80 x1874574705729152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733891.898989:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705729152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733892.214343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733892.214373:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733892.214407:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689968128 00000100:00100000:0.0:1787733892.214418:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689968128 00000100:00100000:0.0:1787733892.214721:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:0.0:1787733892.214730:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2355:x1874574689968128:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733892.214756:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689968256 00000100:00100000:3.0:1787733892.214763:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689968256 00000100:00100000:0.0:1787733892.214797:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2355:x1874574689968128:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 68us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733892.214803:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:3.0:1787733892.214820:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:3.0:1787733892.214830:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689968256:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733892.214879:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689968256:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 51us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733892.214886:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00080000:3.0:1787733892.214904:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787733892.539624:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733893.565248:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733894.588470:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733895.612005:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733895.994373:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787733895.996985:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787733895.997010:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705729408:0@lo:400:kworker.0 00000100:00100000:1.0:1787733895.997073:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733895.997187:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705729280:0@lo:400:kworker.0 00000100:00100000:0.0:1787733895.997214:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733895.997288:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705729280 00000100:00100000:1.0:1787733895.997296:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705729280 00000100:00100000:1.0:1787733895.997337:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787733895.997344:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705729280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733895.997382:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705729280:12345-0@lo:400:kworker.0 Request processed in 39us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733895.997387:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787733895.997455:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705729280:0@lo:400:kworker.0 00000100:00100000:3.0:1787733895.997586:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705729408 00000100:00100000:3.0:1787733895.997590:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705729408 00000100:00100000:3.0:1787733895.997613:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787733895.997617:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705729408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733895.997648:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705729408:12345-0@lo:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733895.997653:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787733895.997713:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705729920:0@lo:400:kworker.0 00000100:00100000:1.0:1787733895.997724:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705729792:0@lo:400:kworker.0 00000100:00100000:3.0:1787733895.997746:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733895.997746:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733895.997760:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705729536:0@lo:400:kworker.0 00000100:00100000:1.0:1787733895.997775:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705729408:0@lo:400:kworker.0 00000100:00100000:3.0:1787733895.997789:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705729920 00000100:00100000:1.0:1787733895.997791:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705729792 00000100:00100000:3.0:1787733895.997792:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705729920 00000100:00100000:1.0:1787733895.997794:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705729792 00000100:00100000:3.0:1787733895.997826:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787733895.997827:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787733895.997832:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705729920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733895.997832:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705729792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733895.997863:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705729920:12345-0@lo:400:kworker.0 Request processed in 31us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733895.997863:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705729792:12345-0@lo:400:kworker.0 Request processed in 30us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733895.997870:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787733895.997870:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787733895.997884:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787733895.997888:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787733895.997894:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705729792:0@lo:400:kworker.0 00010000:00080000:3.0:1787733895.997998:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6ef1c00 x1874574705729920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733895.998009:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705729920:0@lo:400:kworker.0 00000100:00100000:2.0:1787733895.998111:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733895.998140:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787733895.998149:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705729536 00000100:00100000:2.0:1787733895.998150:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705729664:0@lo:400:kworker.0 00000100:00100000:3.0:1787733895.998187:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705729536 00000100:00100000:2.0:1787733895.998200:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733895.998225:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787733895.998232:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705729536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733895.998278:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705729536:12345-0@lo:400:kworker.0 Request processed in 36us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733895.998284:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787733895.998299:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733895.998868:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705729664 00000100:00100000:2.0:1787733895.998874:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705729664 00000100:00100000:2.0:1787733895.998916:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787733895.998926:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705729664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733895.999117:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705729664:12345-0@lo:400:kworker.0 Request processed in 193us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733895.999126:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787733895.999218:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6ef3480 x1874574705729664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733895.999231:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705729664:0@lo:400:kworker.0 00000100:00100000:2.0:1787733895.999421:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705729536:0@lo:400:kworker.0 00000100:00080000:2.0:1787733895.999450:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787733896.507928:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705730048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787733896.508019:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733896.508103:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705730048 00000100:00100000:1.0:1787733896.508110:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705730048 00000100:00100000:1.0:1787733896.508171:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787733896.508181:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705730048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787733896.508218:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733896.508274:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705730048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733896.508281:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787733896.508325:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe93aa00 x1874574705730048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733896.508344:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705730048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787733896.634271:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733897.018361:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787733897.018386:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705730176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733897.018459:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733897.018550:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705730176 00000100:00100000:3.0:1787733897.018557:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705730176 00000100:00100000:3.0:1787733897.018614:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787733897.018625:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705730176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787733897.018658:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733897.018710:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705730176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733897.018717:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787733897.018820:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787733897.018851:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efea9ea00 x1874574705730176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733897.018885:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705730176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787733897.335848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733897.335895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733897.336194:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689968512 00000100:00100000:0.0:1787733897.336205:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689968512 00000100:00100000:0.0:1787733897.336270:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:0.0:1787733897.336281:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2356:x1874574689968512:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733897.336354:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2356:x1874574689968512:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 75us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733897.336894:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:0.0:1787733897.336923:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689968384 00000100:00100000:0.0:1787733897.336928:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689968384 00000100:00100000:0.0:1787733897.336968:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00100000:0.0:1787733897.336975:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2356:x1874574689968384:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733897.337007:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2356:x1874574689968384:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 33us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733897.337175:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00080000:0.0:1787733897.337203:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787733897.664971:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733898.682345:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733899.706294:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787733900.413393:0:10102:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:44:59 (1787733899) === 00000100:00100000:0.0:1787733900.705263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733900.705407:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689968640 00000100:00100000:2.0:1787733900.705431:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689968640 00000100:00100000:2.0:1787733900.705490:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:2.0:1787733900.705501:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:8114:x1874574689968640:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787733900.705519:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733900.705538:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13cb000/0x45228d86de4d563c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df19355 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733900.705568:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13cb000/0x45228d86de4d563c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19355 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733900.705582:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13cb000/0x45228d86de4d563c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19355 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733900.705591:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cb000, rc 0) 00000100:00100000:2.0:1787733900.705743:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:8114:x1874574689968640:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 243us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.705752:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:0.0:1787733900.714613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733900.714741:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689968768 00000100:00100000:1.0:1787733900.714757:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689968768 00000100:00100000:1.0:1787733900.714956:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 203 00000100:00100000:1.0:1787733900.714967:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:8114:x1874574689968768:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787733900.715607:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:8114:x1874574689968768:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 641us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733900.715614:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 203 00000100:00100000:1.0:1787733900.727689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733900.727749:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689968896 00000100:00100000:2.0:1787733900.727760:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689968896 00000100:00100000:2.0:1787733900.727977:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:2.0:1787733900.727989:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:8114:x1874574689968896:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787733900.728451:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:8114:x1874574689968896:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 463us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.728460:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 204 00010000:00010000:2.0:1787733900.730264:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733900.744992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733900.745579:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689969024 00000100:00100000:1.0:1787733900.745593:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689969024 00000100:00100000:1.0:1787733900.745700:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 205 00000100:00100000:1.0:1787733900.745711:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:8118:x1874574689969024:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787733900.746040:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:8118:x1874574689969024:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 330us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733900.746055:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 205 00000100:00100000:0.0:1787733900.764930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733900.765033:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689969152 00000100:00100000:2.0:1787733900.765044:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689969152 00000100:00100000:2.0:1787733900.765148:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:2.0:1787733900.765202:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:8118:x1874574689969152:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787733900.765568:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:8118:x1874574689969152:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 367us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.765576:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:2.0:1787733900.768670:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733900.769461:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689969280 00000100:00100000:1.0:1787733900.769472:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689969280 00000100:00100000:1.0:1787733900.769522:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 207 00000100:00100000:1.0:1787733900.769533:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:8114:x1874574689969280:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787733900.769551:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733900.769571:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cde00/0x45228d86de4d5643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df1937f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733900.769600:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cde00/0x45228d86de4d5643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1937f expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733900.769612:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cde00/0x45228d86de4d5643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1937f expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733900.769621:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cde00, rc 0) 00000100:00100000:1.0:1787733900.769693:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:8114:x1874574689969280:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 161us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733900.769700:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 207 00000100:00100000:1.0:1787733900.776707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733900.777773:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689969408 00000100:00100000:2.0:1787733900.777785:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689969408 00000100:00100000:2.0:1787733900.777855:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:2.0:1787733900.777866:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:8114:x1874574689969408:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787733900.777905:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787733900.777929:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787733900.777934:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787733900.777937:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787733900.777940:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787733900.783365:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:8114:x1874574689969408:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 5479us (6662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.783380:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:1.0:1787733900.790400:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733900.790493:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689969536 00000100:00100000:0.0:1787733900.790504:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689969536 00000100:00100000:0.0:1787733900.790572:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:0.0:1787733900.790584:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:8114:x1874574689969536:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787733900.790618:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733900.790656:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6659c00/0x45228d86de4d564a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df19386 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733900.790687:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6659c00/0x45228d86de4d564a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19386 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733900.790698:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6659c00/0x45228d86de4d564a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19386 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733900.790708:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659c00, rc 0) 00000100:00100000:0.0:1787733900.790788:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:8114:x1874574689969536:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 207us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733900.790796:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:1.0:1787733900.796238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733900.796322:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689969664 00000100:00100000:2.0:1787733900.796332:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689969664 00000100:00100000:2.0:1787733900.796393:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:2.0:1787733900.796405:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:8114:x1874574689969664:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787733900.796707:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:8114:x1874574689969664:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 304us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.796715:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:1.0:1787733900.798561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733900.798692:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689969792 00000100:00100000:2.0:1787733900.798699:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689969792 00000100:00100000:2.0:1787733900.798918:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:2.0:1787733900.798931:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:8114:x1874574689969792:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787733900.799200:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:8114:x1874574689969792:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 270us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.799208:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:1.0:1787733900.808009:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733900.808129:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689969920 00000100:00100000:0.0:1787733900.808140:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689969920 00000100:00100000:1.0:1787733900.808444:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:1.0:1787733900.808456:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:8122:x1874574689969920:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787733900.808747:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:8122:x1874574689969920:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 292us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733900.808756:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:1.0:1787733900.812636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733900.812793:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689970048 00000100:00100000:0.0:1787733900.812804:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689970048 00000100:00100000:0.0:1787733900.812864:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:0.0:1787733900.812885:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:8122:x1874574689970048:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787733900.814058:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:8122:x1874574689970048:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 1168us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733900.814075:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:2.0:1787733900.817993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733900.818406:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689970176 00000100:00100000:3.0:1787733900.818417:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689970176 00000100:00100000:3.0:1787733900.818500:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787733900.818509:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1874574689970176:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787733900.818540:0:8190:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d03688db-9dbe-4e59-8844-cd2ed369e4a4@192.168.201.34@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:3.0:1787733900.818581:0:8190:0:(genops.c:1385:class_connect()) connect: client d03688db-9dbe-4e59-8844-cd2ed369e4a4, cookie 0x45228d86de4d5651 00000004:00100000:3.0:1787733900.818617:0:8190:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787733900.818917:0:8190:0:(import.c:65:import_set_state_nolock()) ffff891ec604c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787733900.818995:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:2353:x1874574689970176:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 485us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733900.819464:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1787733900.820205:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733900.829642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733900.831277:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689970560 00000100:00100000:2.0:1787733900.831292:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689970560 00000100:00100000:2.0:1787733900.831395:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1787733900.831406:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689970560:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:3.0:1787733900.831450:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733900.831512:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689970560:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 108us (11310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.831520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1787733900.831536:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689970304 00000100:00100000:2.0:1787733900.831539:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689970304 00000100:00100000:2.0:1787733900.831566:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1787733900.831572:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:0:x1874574689970304:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787733900.831605:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787733900.831659:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:0:x1874574689970304:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 87us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.831666:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00080000:2.0:1787733900.831681:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733900.831864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733900.832123:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689970432 00000100:00100000:2.0:1787733900.832128:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689970432 00000100:00100000:2.0:1787733900.832151:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1787733900.832178:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:8114:x1874574689970432:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787733900.832205:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787733900.832255:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:8114:x1874574689970432:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 69us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.832263:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1787733900.839485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733900.839577:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689970688 00000100:00100000:2.0:1787733900.839586:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689970688 00000100:00100000:2.0:1787733900.839650:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1787733900.839661:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:8114:x1874574689970688:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787733900.839952:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:8114:x1874574689970688:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 291us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.839960:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1787733900.842797:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733900.843483:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689970816 00000100:00100000:3.0:1787733900.843496:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689970816 00000100:00100000:3.0:1787733900.843547:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1787733900.843555:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874574689970816:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787733900.843591:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d03688db-9dbe-4e59-8844-cd2ed369e4a4@192.168.201.34@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:3.0:1787733900.843693:0:6679:0:(genops.c:1385:class_connect()) connect: client d03688db-9dbe-4e59-8844-cd2ed369e4a4, cookie 0x45228d86de4d5658 00002000:00100000:3.0:1787733900.843706:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d03688db-9dbe-4e59-8844-cd2ed369e4a4/ffff891ec604f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787733900.843731:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787733900.843939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733900.843974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733900.844029:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689971072 00000100:00100000:0.0:1787733900.844034:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689971072 00000100:00100000:0.0:1787733900.844072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:0.0:1787733900.844080:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:8114:x1874574689971072:12345-192.168.201.34@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787733900.844340:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787733900.844543:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689970944 00000100:00100000:2.0:1787733900.844547:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689970944 00000100:00100000:2.0:1787733900.844578:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1787733900.844584:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1874574689970944:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787733900.844602:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d03688db-9dbe-4e59-8844-cd2ed369e4a4@192.168.201.34@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1787733900.844622:0:6681:0:(genops.c:1385:class_connect()) connect: client d03688db-9dbe-4e59-8844-cd2ed369e4a4, cookie 0x45228d86de4d565f 00002000:00100000:2.0:1787733900.844628:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d03688db-9dbe-4e59-8844-cd2ed369e4a4/ffff891ed1dd6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787733900.844644:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787733900.845079:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787733900.845105:0:6681:0:(import.c:65:import_set_state_nolock()) ffff891ed1dd7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787733900.845188:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:2353:x1874574689970944:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 603us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733900.845196:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1787733900.845703:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:8114:x1874574689971072:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 1622us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733900.845716:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00002000:00080000:3.0:1787733900.845962:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787733900.845981:0:6679:0:(import.c:65:import_set_state_nolock()) ffff891ec604c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787733900.846004:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:2353:x1874574689970816:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 2450us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733900.846012:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1787733901.118557:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705730432:0@lo:400:kworker.0 00000100:00100000:2.0:1787733901.118634:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733901.118733:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705730560:0@lo:400:kworker.0 00000100:00100000:2.0:1787733901.118760:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733901.118819:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787733901.118826:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705730688:0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.119203:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705730432 00000100:00100000:3.0:1787733901.119214:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705730432 00000100:00100000:3.0:1787733901.119252:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705730560 00000100:00100000:3.0:1787733901.119255:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705730560 00000100:00100000:3.0:1787733901.119286:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787733901.119295:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705730432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.119349:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705730432:12345-0@lo:400:kworker.0 Request processed in 55us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733901.119356:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787733901.119373:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787733901.119379:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705730560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.119404:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705730560:12345-0@lo:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733901.119420:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787733901.119436:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733901.119466:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705730432:0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.119473:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705730944:0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.119501:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733901.119551:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787733901.119557:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705730304:0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.119584:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733901.119606:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705730816:0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.119628:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733901.119659:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705730944 00000100:00100000:3.0:1787733901.119662:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705730944 00000100:00100000:3.0:1787733901.119700:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787733901.119706:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705730944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.119738:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705730944:12345-0@lo:400:kworker.0 Request processed in 32us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733901.119755:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787733901.119770:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787733901.119776:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705730816 00000100:00100000:3.0:1787733901.119780:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705730816 00000100:00100000:3.0:1787733901.119800:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787733901.119806:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705730816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.119832:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705730816:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733901.119839:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787733901.119859:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733901.119892:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705730816:0@lo:400:kworker.0 00010000:00080000:3.0:1787733901.119904:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6ef0000 x1874574705730944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733901.119914:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705730944:0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.119982:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733901.120006:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705730560:0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.120029:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705730688 00000100:00100000:3.0:1787733901.120033:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705730688 00000100:00100000:3.0:1787733901.120061:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787733901.120066:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705730688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733901.120102:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705730688:12345-0@lo:400:kworker.0 Request processed in 35us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733901.120108:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787733901.120122:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787733901.120134:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6ef1c00 x1874574705730688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733901.120143:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705730688:0@lo:400:kworker.0 00000100:00100000:0.0:1787733901.120508:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705730304 00000100:00100000:0.0:1787733901.120513:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705730304 00000100:00100000:0.0:1787733901.120539:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787733901.120546:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705730304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733901.120584:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705730304:12345-0@lo:400:kworker.0 Request processed in 38us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733901.120590:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787733901.120623:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705730304:0@lo:400:kworker.0 00000001:00100000:1.0:1787733901.206349:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d03688db-9dbe-4e59-8844-cd2ed369e4a4 00000001:00100000:2.0:1787733901.227672:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d03688db-9dbe-4e59-8844-cd2ed369e4a4 00000100:00100000:0.0:1787733901.626684:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787733901.626708:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705731072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787733901.626784:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733901.626885:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705731072 00000100:00100000:0.0:1787733901.626893:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705731072 00000100:00100000:0.0:1787733901.626945:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787733901.626955:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefdabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705731072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787733901.626977:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787733901.627021:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefdabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705731072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733901.627028:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787733901.627068:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff04380 x1874574705731072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733901.627086:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705731072:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787733901.755708:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733902.145963:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787733902.145986:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705731200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787733902.146264:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733902.146493:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705731200 00000100:00100000:1.0:1787733902.146502:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705731200 00000100:00100000:1.0:1787733902.146553:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787733902.146562:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705731200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787733902.146600:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733902.146654:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705731200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733902.146661:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787733902.147294:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff05c00 x1874574705731200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733902.147314:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705731200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787733902.778582:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787733903.738581:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d03688db-9dbe-4e59-8844-cd2ed369e4a4 00010000:00010000:2.0:1787733903.805853:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733904.826336:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733905.851248:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787733905.928646:0:10299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787733906.038970:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733906.039010:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733906.039040:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733906.039060:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733906.039084:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733906.039139:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689971200 00000100:00100000:3.0:1787733906.039152:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689971200 00000100:00100000:3.0:1787733906.039229:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:3.0:1787733906.039240:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574689971200:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733906.039313:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574689971200:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 74us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733906.039322:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:3.0:1787733906.039356:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689971456 00000100:00100000:3.0:1787733906.039360:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689971456 00000100:00100000:3.0:1787733906.039397:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689971328 00000100:00100000:3.0:1787733906.039399:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689971328 00000100:00100000:3.0:1787733906.039421:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1787733906.039428:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689971456:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733906.039459:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689971456:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733906.039465:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1787733906.039478:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1787733906.039484:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574689971328:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733906.039507:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574689971328:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733906.039514:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1787733906.039532:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689971712 00000100:00100000:3.0:1787733906.039535:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689971712 00000100:00100000:3.0:1787733906.039561:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689971584 00000100:00100000:3.0:1787733906.039564:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689971584 00000100:00100000:3.0:1787733906.039583:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1787733906.039589:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689971712:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733906.039622:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689971712:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733906.039629:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1787733906.039640:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:3.0:1787733906.039646:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689971584:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733906.039666:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689971584:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 21us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733906.039672:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00080000:3.0:1787733906.039816:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787733906.039821:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787733906.039823:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733906.234692:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705731456:0@lo:400:kworker.0 00000100:00100000:1.0:1787733906.234722:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705731584:0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.234786:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733906.234851:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705731968:0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.234882:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733906.234888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733906.234939:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733906.234946:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705731712:0@lo:400:kworker.0 00000100:00100000:1.0:1787733906.234977:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733906.234978:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787733906.234986:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705731328:0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.238735:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733906.238812:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705731840:0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.238851:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733906.238900:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705731456 00000100:00100000:3.0:1787733906.238908:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705731456 00000100:00100000:3.0:1787733906.238953:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705731584 00000100:00100000:3.0:1787733906.238956:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705731584 00000100:00100000:3.0:1787733906.238978:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705731840 00000100:00100000:3.0:1787733906.238981:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705731840 00000100:00100000:3.0:1787733906.239016:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787733906.239024:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705731456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.239081:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705731456:12345-0@lo:400:kworker.0 Request processed in 57us (4306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733906.239087:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787733906.239104:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787733906.239110:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705731584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.239136:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705731584:12345-0@lo:400:kworker.0 Request processed in 27us (4251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733906.239142:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787733906.239152:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787733906.239556:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705731840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.239660:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705731840:12345-0@lo:400:kworker.0 Request processed in 108us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733906.239666:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1787733906.239691:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733906.239722:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705731840:0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.239736:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705731456:0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.239799:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705731328 00000100:00100000:3.0:1787733906.239803:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705731328 00000100:00100000:3.0:1787733906.239830:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787733906.239836:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705731328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.239871:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705731328:12345-0@lo:400:kworker.0 Request processed in 35us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733906.239877:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787733906.240511:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705731328:0@lo:400:kworker.0 00000100:00100000:1.0:1787733906.244586:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705731584:0@lo:400:kworker.0 00000100:00100000:2.0:1787733906.248734:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705731968 00000100:00100000:2.0:1787733906.248751:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705731968 00000100:00100000:2.0:1787733906.248912:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705731712 00000100:00100000:2.0:1787733906.248916:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705731712 00000100:00100000:1.0:1787733906.248971:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787733906.248997:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705731968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733906.249106:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705731968:12345-0@lo:400:kworker.0 Request processed in 125us (14224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733906.249115:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787733906.250848:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787733906.250858:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787733906.252860:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59ce00 x1874574705731968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733906.252880:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705731968:0@lo:400:kworker.0 00000100:00100000:2.0:1787733906.253526:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787733906.253540:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705731712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733906.255573:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705731712:12345-0@lo:400:kworker.0 Request processed in 2028us (20585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733906.255600:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787733906.255838:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6d9c380 x1874574705731712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733906.255856:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705731712:0@lo:400:kworker.0 00000100:00100000:3.0:1787733906.746468:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787733906.746489:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705732096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787733906.746565:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733906.746686:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705732096 00000100:00100000:1.0:1787733906.746695:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705732096 00000100:00100000:1.0:1787733906.746749:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787733906.746759:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705732096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787733906.746807:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733906.746864:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705732096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733906.746872:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787733906.746996:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff04380 x1874574705732096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733906.747016:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705732096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787733906.874451:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733907.264180:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733907.264211:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705732224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787733907.264325:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733907.264406:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705732224 00000100:00100000:1.0:1787733907.264415:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705732224 00000100:00100000:1.0:1787733907.264464:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787733907.264474:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705732224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787733907.264511:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733907.264564:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705732224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733907.264572:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787733907.264611:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff04380 x1874574705732224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733907.264631:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705732224:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787733907.898232:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733908.924646:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733909.946323:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733910.970493:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733911.157387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733911.157423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733911.157465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733911.157485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733911.157590:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689972224 00000100:00100000:0.0:1787733911.157601:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689972224 00000100:00100000:0.0:1787733911.157664:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1787733911.157674:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2357:x1874574689972224:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733911.157754:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2357:x1874574689972224:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 82us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733911.157763:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00080000:0.0:1787733911.157784:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787733911.157820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733911.158113:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689972352 00000100:00100000:0.0:1787733911.158126:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689972352 00000100:00100000:0.0:1787733911.158179:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1787733911.158187:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2357:x1874574689972352:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733911.158216:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2357:x1874574689972352:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733911.158222:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00080000:0.0:1787733911.158240:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787733911.158580:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689971968 00000100:00100000:3.0:1787733911.158586:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689971968 00000100:00100000:3.0:1787733911.158664:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689972096 00000100:00100000:3.0:1787733911.158668:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689972096 00000100:00100000:3.0:1787733911.158707:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1787733911.158715:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2357:x1874574689971968:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733911.158754:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2357:x1874574689971968:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733911.158760:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1787733911.158774:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1787733911.158781:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2357:x1874574689972096:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733911.158803:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2357:x1874574689972096:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733911.158829:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1787733911.158848:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689971840 00000100:00100000:3.0:1787733911.158852:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689971840 00000100:00100000:3.0:1787733911.158878:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:3.0:1787733911.158885:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2357:x1874574689971840:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733911.158911:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2357:x1874574689971840:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733911.158917:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00080000:0.0:1787733911.159319:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733911.367421:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705732352:0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.367516:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733911.367566:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705732864:0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.367594:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733911.367621:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787733911.367627:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705732480:0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.367650:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733911.367667:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec6d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705732992:0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.367703:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733911.367734:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705732736:0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.367757:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733911.367775:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787733911.367780:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705732608:0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.367819:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733911.367846:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705732352 00000100:00100000:3.0:1787733911.367854:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705732352 00000100:00100000:3.0:1787733911.367900:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787733911.367909:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705732352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.367953:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705732352:12345-0@lo:400:kworker.0 Request processed in 46us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733911.367960:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787733911.367990:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705732864 00000100:00100000:3.0:1787733911.367994:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705732864 00000100:00100000:3.0:1787733911.368026:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705732480 00000100:00100000:3.0:1787733911.368029:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705732480 00000100:00100000:3.0:1787733911.368041:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705732608 00000100:00100000:3.0:1787733911.368043:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705732608 00000100:00100000:3.0:1787733911.368057:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787733911.368063:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705732864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.368092:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705732864:12345-0@lo:400:kworker.0 Request processed in 30us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733911.368099:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787733911.368111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787733911.368117:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705732480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.368141:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705732480:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733911.368147:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787733911.368176:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787733911.368183:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705732608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.368212:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705732608:12345-0@lo:400:kworker.0 Request processed in 30us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733911.368217:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787733911.368236:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705732992 00000100:00100000:3.0:1787733911.368246:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705732992 00000100:00100000:3.0:1787733911.368273:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705732736 00000100:00100000:3.0:1787733911.368276:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705732736 00000100:00100000:3.0:1787733911.368295:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787733911.368301:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705732992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.368331:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705732992:12345-0@lo:400:kworker.0 Request processed in 30us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733911.368336:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787733911.368346:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787733911.368351:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705732736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.368373:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705732736:12345-0@lo:400:kworker.0 Request processed in 23us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733911.368378:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787733911.368416:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705732480:0@lo:400:kworker.0 00010000:00080000:3.0:1787733911.368428:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec6d9d880 x1874574705732992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733911.368438:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705732992:0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.368445:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705732352:0@lo:400:kworker.0 00000100:00100000:3.0:1787733911.368453:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec6d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705732864:0@lo:400:kworker.0 00000100:00080000:3.0:1787733911.368484:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787733911.368487:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787733911.368490:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733911.368501:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705732608:0@lo:400:kworker.0 00010000:00080000:3.0:1787733911.368510:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ed2004000 x1874574705732736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733911.368530:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705732736:0@lo:400:kworker.0 00000100:00100000:2.0:1787733911.866657:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705733120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787733911.866749:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733911.867009:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705733120 00000100:00100000:1.0:1787733911.867019:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705733120 00000100:00100000:1.0:1787733911.867074:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787733911.867093:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705733120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787733911.867128:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733911.867221:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705733120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733911.867229:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787733911.867391:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec60c9f80 x1874574705733120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733911.867413:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705733120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787733911.996026:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733912.378761:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787733912.378788:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705733248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787733912.378863:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733912.379051:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705733248 00000100:00100000:1.0:1787733912.379060:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705733248 00000100:00100000:1.0:1787733912.379107:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787733912.379117:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705733248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787733912.379196:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733912.379251:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705733248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733912.379276:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787733912.379541:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec60cb100 x1874574705733248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733912.379561:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705733248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787733913.027357:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733914.046065:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733915.070031:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733916.092244:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733916.283959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733916.285842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733916.285871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733916.285895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733916.286268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733916.286594:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689972864 00000100:00100000:1.0:1787733916.286618:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689972864 00000100:00100000:1.0:1787733916.286675:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689972992 00000100:00100000:2.0:1787733916.286758:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689972608 00000100:00100000:2.0:1787733916.286763:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689972608 00000100:00100000:2.0:1787733916.286795:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689972736 00000100:00100000:2.0:1787733916.286798:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689972736 00000100:00100000:2.0:1787733916.286820:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:2.0:1787733916.286830:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574689972608:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733916.286908:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574689972608:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 78us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733916.286917:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:2.0:1787733916.286934:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:2.0:1787733916.286941:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689972736:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733916.286966:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689972736:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733916.286979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:1.0:1787733916.287098:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689972992 00000100:00100000:1.0:1787733916.287125:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1787733916.287132:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef63f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689972864:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733916.287173:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef63f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689972864:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 42us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733916.287179:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1787733916.287399:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:1.0:1787733916.287406:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689972992:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733916.288361:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689972992:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 950us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733916.288369:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:1.0:1787733916.288395:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689972480 00000100:00100000:1.0:1787733916.288400:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689972480 00000100:00100000:1.0:1787733916.288443:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:1.0:1787733916.288451:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574689972480:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733916.288490:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574689972480:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733916.288497:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00080000:1.0:1787733916.288529:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787733916.288534:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787733916.288537:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787733916.486760:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705733632:0@lo:400:kworker.0 00000100:00100000:2.0:1787733916.487534:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733916.487540:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705733760:0@lo:400:kworker.0 00000100:00100000:0.0:1787733916.487587:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733916.487628:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705733632 00000100:00100000:2.0:1787733916.487636:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705733632 00000100:00100000:2.0:1787733916.487719:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787733916.487726:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733916.487729:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705733632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733916.488040:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705733632:12345-0@lo:400:kworker.0 Request processed in 250us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733916.488048:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787733916.488095:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705733632:0@lo:400:kworker.0 00000100:00100000:2.0:1787733916.488133:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705733504:0@lo:400:kworker.0 00000100:00100000:2.0:1787733916.488180:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733916.488212:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705734016:0@lo:400:kworker.0 00000100:00100000:0.0:1787733916.488281:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705733504 00000100:00100000:0.0:1787733916.488286:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705733504 00000100:00100000:0.0:1787733916.488316:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787733916.488336:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705733504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733916.488370:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705733504:12345-0@lo:400:kworker.0 Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733916.488389:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787733916.488520:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705733376:0@lo:400:kworker.0 00000100:00100000:1.0:1787733916.488555:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733916.488606:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705733888:0@lo:400:kworker.0 00000100:00100000:1.0:1787733916.488639:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733916.488642:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705733376 00000100:00100000:0.0:1787733916.488646:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705733376 00000100:00100000:0.0:1787733916.488674:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787733916.488681:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705733376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733916.488689:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705733888 00000100:00100000:1.0:1787733916.488693:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705733888 00000100:00100000:0.0:1787733916.488715:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705733376:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733916.488722:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787733916.488723:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787733916.488729:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705733888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733916.488774:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705733888:12345-0@lo:400:kworker.0 Request processed in 45us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733916.488780:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787733916.488797:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733916.489075:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705733760 00000100:00100000:1.0:1787733916.489080:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705733760 00000100:00100000:1.0:1787733916.489126:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787733916.489133:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733916.489198:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705733760:12345-0@lo:400:kworker.0 Request processed in 65us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733916.489204:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787733916.489281:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787733916.489321:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59dc00 x1874574705733760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733916.489345:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705733760:0@lo:400:kworker.0 00000100:00100000:1.0:1787733916.489382:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705733376:0@lo:400:kworker.0 00000100:00100000:1.0:1787733916.489393:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705733888:0@lo:400:kworker.0 00000100:00100000:2.0:1787733916.489922:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733916.489974:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705733504:0@lo:400:kworker.0 00000100:00100000:1.0:1787733916.493296:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705734016 00000100:00100000:1.0:1787733916.493312:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705734016 00000100:00100000:1.0:1787733916.493386:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787733916.493397:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705734016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733916.493507:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705734016:12345-0@lo:400:kworker.0 Request processed in 113us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733916.493514:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787733916.493643:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787733916.494503:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59df80 x1874574705734016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733916.494521:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705734016:0@lo:400:kworker.0 00000100:00100000:2.0:1787733916.986916:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705734144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787733916.987024:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733916.987052:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705734144 00000100:00100000:1.0:1787733916.987059:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705734144 00000100:00100000:1.0:1787733916.987110:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787733916.987121:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705734144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787733916.987184:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733916.987237:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705734144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733916.987244:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787733916.987284:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec60c8e00 x1874574705734144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733916.987603:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705734144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787733917.114650:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733917.502927:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705734272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787733917.503004:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733917.503342:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705734272 00000100:00100000:1.0:1787733917.503358:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705734272 00000100:00100000:1.0:1787733917.503419:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787733917.503428:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705734272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787733917.503463:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733917.503525:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705734272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733917.503541:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787733917.503777:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec60c8000 x1874574705734272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733917.503805:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705734272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787733918.138535:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733919.162289:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733920.187421:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733921.210541:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733921.395861:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733921.395911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733921.395931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733921.395954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733921.395980:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733921.396009:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689973376 00000100:00100000:3.0:1787733921.396018:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689973376 00000100:00100000:3.0:1787733921.396079:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689973248 00000100:00100000:3.0:1787733921.396082:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689973248 00000100:00100000:3.0:1787733921.396103:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:3.0:1787733921.396113:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689973376:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733921.396213:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689973376:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733921.396222:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:3.0:1787733921.396238:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:3.0:1787733921.396253:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574689973248:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733921.396278:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574689973248:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733921.396285:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:3.0:1787733921.396306:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689973504 00000100:00100000:3.0:1787733921.396310:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689973504 00000100:00100000:3.0:1787733921.396347:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689973632 00000100:00100000:3.0:1787733921.396350:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689973632 00000100:00100000:3.0:1787733921.396372:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1787733921.396379:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2353:x1874574689973504:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:3.0:1787733921.396397:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5658 00000100:00080000:3.0:1787733921.396406:0:6682:0:(import.c:65:import_set_state_nolock()) ffff891ec604c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787733921.396448:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787733921.396751:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689973120 00000100:00100000:0.0:1787733921.396756:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689973120 00000100:00100000:0.0:1787733921.396788:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:3.0:1787733921.396790:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+2:2353:x1874574689973504:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 413us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733921.396795:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574689973120:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733921.396797:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1787733921.396809:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1787733921.396814:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2353:x1874574689973632:12345-192.168.201.34@tcp:9:kworker.0 00000100:00100000:0.0:1787733921.396820:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574689973120:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (973us total) trans 0 rc 0/0 00000020:00000080:3.0:1787733921.396824:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d565f 00000100:00100000:0.0:1787733921.396825:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00080000:3.0:1787733921.396830:0:6682:0:(import.c:65:import_set_state_nolock()) ffff891ed1dd7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787733921.396858:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787733921.397049:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+2:2353:x1874574689973632:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 233us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733921.397056:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00080000:3.0:1787733921.397076:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787733921.397079:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787733921.397089:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787733921.397526:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733921.397533:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733921.594474:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787733921.594538:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787733921.594561:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefdab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705734528:0@lo:400:kworker.0 00000100:00100000:3.0:1787733921.594589:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefda9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705734400:0@lo:400:kworker.0 00000100:00100000:0.0:1787733921.594694:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefdaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705734656:0@lo:400:kworker.0 00000100:00100000:3.0:1787733921.601654:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733921.601796:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefda8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705735040:0@lo:400:kworker.0 00000100:00100000:2.0:1787733921.602178:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733921.602214:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefda8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705734912:0@lo:400:kworker.0 00000100:00100000:2.0:1787733921.602329:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733921.602816:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733921.602859:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705734400 00000100:00100000:3.0:1787733921.602867:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705734400 00000100:00100000:3.0:1787733921.602911:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787733921.602919:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705734400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733921.602970:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705734400:12345-0@lo:400:kworker.0 Request processed in 51us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733921.602976:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787733921.603007:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705734528 00000100:00100000:3.0:1787733921.603011:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705734528 00000100:00100000:3.0:1787733921.603033:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705734912 00000100:00100000:3.0:1787733921.603037:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705734912 00000100:00100000:3.0:1787733921.603064:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787733921.603069:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705734528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733921.603109:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705734528:12345-0@lo:400:kworker.0 Request processed in 39us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733921.603115:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787733921.603126:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787733921.603132:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705734912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733921.603174:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705734912:12345-0@lo:400:kworker.0 Request processed in 42us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733921.603186:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787733921.603204:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705735040 00000100:00100000:3.0:1787733921.603207:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705735040 00000100:00100000:2.0:1787733921.603217:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefda8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705734912:0@lo:400:kworker.0 00000100:00100000:2.0:1787733921.603230:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefdab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705734528:0@lo:400:kworker.0 00000100:00100000:3.0:1787733921.603231:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787733921.603425:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705735040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733921.603459:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705735040:12345-0@lo:400:kworker.0 Request processed in 222us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733921.603465:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787733921.603489:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787733921.603493:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787733921.603610:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eefda8000 x1874574705735040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733921.603622:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefda8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705735040:0@lo:400:kworker.0 00000100:00100000:3.0:1787733921.603632:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefda9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705734400:0@lo:400:kworker.0 00000100:00100000:0.0:1787733921.603789:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefdaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705734784:0@lo:400:kworker.0 00000100:00100000:0.0:1787733921.603821:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733921.604173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733921.604617:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705734784 00000100:00100000:3.0:1787733921.604622:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705734784 00000100:00100000:3.0:1787733921.604808:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787733921.604816:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705734784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733921.604868:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705734784:12345-0@lo:400:kworker.0 Request processed in 53us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733921.604874:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787733921.604914:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eefdaad80 x1874574705734784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733921.604944:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefdaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705734784:0@lo:400:kworker.0 00000100:00080000:3.0:1787733921.604965:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787733921.604981:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705734656 00000100:00100000:3.0:1787733921.604985:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705734656 00000100:00080000:2.0:1787733921.605023:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733921.609330:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787733921.609347:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefdab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705734656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733921.609442:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefdab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705734656:12345-0@lo:400:kworker.0 Request processed in 101us (5287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733921.609449:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787733921.609588:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefdaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705734656:0@lo:400:kworker.0 00000001:00100000:0.0:1787733921.692397:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d03688db-9dbe-4e59-8844-cd2ed369e4a4 00000020:00000080:0.0:1787733921.692407:0:7629:0:(genops.c:885:class_export_put()) final put ffff891ed1dd6800/d03688db-9dbe-4e59-8844-cd2ed369e4a4 00000020:00000080:0.0:1787733921.692443:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ed1dd6800/d03688db-9dbe-4e59-8844-cd2ed369e4a4 for lustre-OST0001 00000020:00000080:0.0:1787733921.692491:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ed1dd7000 for lustre-OST0001 00000100:00100000:0.0:1787733922.106523:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787733922.106548:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705735168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787733922.106690:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733922.107435:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705735168 00000100:00100000:1.0:1787733922.107444:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705735168 00000100:00100000:1.0:1787733922.107498:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787733922.107517:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705735168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787733922.107553:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733922.107618:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705735168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733922.107625:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787733922.107748:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec60c9880 x1874574705735168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733922.111947:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705735168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787733922.234664:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733922.618643:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705735296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787733922.618719:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733922.619013:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705735296 00000100:00100000:0.0:1787733922.619022:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705735296 00000100:00100000:0.0:1787733922.619115:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787733922.619126:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705735296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787733922.619202:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787733922.619674:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705735296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 549us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733922.619682:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787733922.619758:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec60cb480 x1874574705735296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733922.619777:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705735296:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787733923.049062:0:11002:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787733923.258501:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787733924.285115:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d03688db-9dbe-4e59-8844-cd2ed369e4a4 00000020:00000080:2.0:1787733924.285124:0:6705:0:(genops.c:885:class_export_put()) final put ffff891ec604f000/d03688db-9dbe-4e59-8844-cd2ed369e4a4 00010000:00010000:2.0:1787733924.285179:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787733924.285483:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec604f000/d03688db-9dbe-4e59-8844-cd2ed369e4a4 for lustre-OST0000 00000020:00000080:1.0:1787733924.285797:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ec604c800 for lustre-OST0000 00010000:00010000:2.0:1787733925.306293:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787733926.299648:0:11153:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1cd5c4a0 20000000:00000080:0.0:1787733926.299667:0:11153:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff891ef692a800 uarg=0000000000000000 20000000:01000000:0.0:1787733926.299701:0:11153:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787733926.299708:0:11153:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787733926.299712:0:11153:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787733926.300417:0:11154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787733926.300518:0:11153:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787733926.304190:0:11153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787733926.304223:0:11153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304244:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec6658400/0x45228d86de4d55cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d55c5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304253:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec13ca600/0x45228d86de4d55f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d55ef expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304261:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891efe7ed600/0x45228d86de4d5620 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5619 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304286:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec13caa00/0x45228d86de4d5635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1934e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304294:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec6659c00/0x45228d86de4d564a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19386 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304302:0:11153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304345:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec6659c00/0x45228d86de4d564a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19386 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304359:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec6659c00/0x45228d86de4d564a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19386 expref: 12 pid: 5826 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733926.304374:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef78b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874574705735424:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733926.304500:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec13caa00/0x45228d86de4d5635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1934e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304509:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec13caa00/0x45228d86de4d5635 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1934e expref: 12 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733926.304515:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef78a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874574705735552:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733926.304542:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891efe7ed600/0x45228d86de4d5620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d5619 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304548:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891efe7ed600/0x45228d86de4d5620 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d5619 expref: 18 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733926.304563:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef78ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874574705735680:0@lo:104: 00000100:00100000:2.0:1787733926.304604:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733926.304633:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705735680 00010000:00010000:2.0:1787733926.304634:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec13ca600/0x45228d86de4d55f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d55ef expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304644:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec13ca600/0x45228d86de4d55f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d55ef expref: 18 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733926.304652:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705735680 00000100:00100000:2.0:1787733926.304654:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef788000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874574705735808:0@lo:104: 00000100:00100000:2.0:1787733926.304681:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787733926.304706:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec6658400/0x45228d86de4d55cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d55c5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.304712:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec6658400/0x45228d86de4d55cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d55c5 expref: 18 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733926.304720:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef78b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874574705735936:0@lo:104: 00000100:00100000:2.0:1787733926.304734:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733926.304758:0:11153:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee547ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733926.304761:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705735808 00000100:00100000:3.0:1787733926.304766:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705735808 00000100:00100000:3.0:1787733926.304781:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705735936 00000100:00100000:3.0:1787733926.304783:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705735936 00000100:00100000:3.0:1787733926.304795:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787733926.304809:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef788a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+5:11153:x1874574705735680:12345-0@lo:104: 00010000:00010000:3.0:1787733926.304821:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.304893:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787733926.304911:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef788a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+5:11153:x1874574705735680:12345-0@lo:104: Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733926.304919:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef78ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874574705735680:0@lo:104: 00010000:00010000:0.0:1787733926.304919:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787733926.304921:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787733926.304931:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.304941:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020ff800 already unused, calling callback (ffffffffc1b18c20) 00000100:00100000:3.0:1787733926.304942:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 10000000:00010000:0.0:1787733926.304948:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733926.304950:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+4:11153:x1874574705735808:12345-0@lo:104: 00010000:00010000:3.0:1787733926.304963:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.304966:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787733926.304983:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733926.304990:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787733926.305017:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787733926.305018:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef788000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874574705735808:0@lo:104: 00000100:00100000:3.0:1787733926.305026:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+4:11153:x1874574705735808:12345-0@lo:104: Request processed in 76us (344us total) trans 0 rc 0/0 00010000:00010000:0.0:1787733926.305031:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733926.305036:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787733926.305044:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787733926.305058:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787733926.305067:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef788380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:11153:x1874574705735936:12345-0@lo:104: 00010000:00010000:0.0:1787733926.305071:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.305076:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733926.305077:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefda9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705736064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787733926.305084:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020ff800/0x45228d86de4d5619 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5620 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.305105:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787733926.305109:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733926.305113:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787733926.305121:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec200 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787733926.305125:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.305132:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.305136:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:0.0:1787733926.305139:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733926.305143:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef788380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:11153:x1874574705735936:12345-0@lo:104: Request processed in 76us (406us total) trans 0 rc 0/0 10000000:01000000:0.0:1787733926.305172:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787733926.305189:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787733926.305210:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787733926.305212:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.305220:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787733926.305235:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705736064 00010000:00010000:0.0:1787733926.305237:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733926.305241:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705736064 00010000:00010000:0.0:1787733926.305249:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891efe7ec200/0x45228d86de4d55ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d55f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.305260:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891efe7ed600/0x45228d86de4d5620 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5619 expref: 19 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.305262:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733926.305266:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733926.305269:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733926.305283:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefdaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705736192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787733926.305303:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787733926.305307:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef78b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874574705735936:0@lo:104: 00000100:00100000:0.0:1787733926.305331:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733926.305418:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705736192 00000100:00100000:1.0:1787733926.305424:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705736192 00010000:00010000:1.0:1787733926.305455:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec13ca600/0x45228d86de4d55f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d55ef expref: 20 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733926.305554:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+20:3310:x1874574705736064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787733926.305564:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733926.305570:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891efe7ed600/0x45228d86de4d5620 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5619 expref: 20 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.305580:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891efe7ed600/0x45228d86de4d5620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d5619 expref: 20 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.305593:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891efe7ed600/0x45228d86de4d5620 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d5619 expref: 20 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.305602:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733926.305631:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787733926.305632:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705736064:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733926.305646:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefdaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705736192:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787733926.305650:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787733926.305663:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787733926.305664:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefda9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705736064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787733926.305673:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec13ca600/0x45228d86de4d55f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d55ef expref: 18 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.305686:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec13ca600/0x45228d86de4d55f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d55ef expref: 18 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.305710:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13ca600/0x45228d86de4d55f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d55ef expref: 18 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.305720:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733926.305780:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefdaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df19622b-ae94-4c8d-b052-574898624480+17:3311:x1874574705736192:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733926.305788:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787733926.305797:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefdaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705736192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787733926.306002:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733926.306005:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733926.306007:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733926.306025:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.306033:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659800 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787733926.306036:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.306043:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733926.306050:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733926.306066:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787733926.306131:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.306138:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787733926.306176:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705736320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787733926.306272:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787733926.306303:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733926.306358:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705736320 00000100:00100000:0.0:1787733926.306364:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705736320 00010000:00010000:0.0:1787733926.306382:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec6658400/0x45228d86de4d55cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d55c5 expref: 17 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733926.306442:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d55c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d55cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733926.306450:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787733926.306458:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733926.306461:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+17:3312:x1874574705736320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787733926.306462:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733926.306466:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733926.306474:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733926.306480:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec6658400/0x45228d86de4d55cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d55c5 expref: 17 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.306488:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec6658400/0x45228d86de4d55cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d55c5 expref: 17 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.306505:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec6658400/0x45228d86de4d55cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d55c5 expref: 17 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.306515:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733926.306557:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+16:3312:x1874574705736320:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733926.306565:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787733926.306573:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705736320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787733926.308252:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef78b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874574705735424:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787733926.308263:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733926.308285:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef78a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874574705735552:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733926.308310:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689973760 00000100:00100000:0.0:1787733926.308318:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689973760 00010000:00010000:1.0:1787733926.308322:0:11153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.308345:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec6659c00/0x45228d86de4d564a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19386 expref: 13 pid: 5826 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733926.308346:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733926.308372:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689973888 00000100:00100000:1.0:1787733926.308378:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689973888 00000100:00100000:0.0:1787733926.308384:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1787733926.308395:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+14:2355:x1874574689973760:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733926.308409:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec13caa00/0x45228d86de4d5635 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1934e expref: 14 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.308410:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733926.308419:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec6659c00/0x45228d86de4d564a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19386 expref: 14 pid: 5826 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.308452:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec6659c00/0x45228d86de4d564a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19386 expref: 14 pid: 5826 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733926.308454:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1787733926.308462:0:7616:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787733926.308467:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+14:2355:x1874574689973888:12345-192.168.201.34@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787733926.308474:0:7616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1787733926.308479:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733926.308479:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec6659c00/0x45228d86de4d564a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19386 expref: 14 pid: 5826 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.308489:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec13caa00/0x45228d86de4d5635 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1934e expref: 14 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733926.308495:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733926.308502:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec13caa00/0x45228d86de4d5635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1934e expref: 13 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.308515:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13caa00/0x45228d86de4d5635 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1934e expref: 13 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733926.308553:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:2355:x1874574689973760:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 152us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1787733926.308554:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733926.308567:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00010000:00010000:1.0:1787733926.308569:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.308586:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.308606:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.308613:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.308620:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.308627:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787733926.308632:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.308641:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.308661:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733926.308671:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787733926.308688:0:11153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.308698:0:11153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733926.308705:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13cbe00/0x45228d86de4d5666 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733926.308716:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:2355:x1874574689973888:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 251us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733926.308732:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00010000:00010000:0.0:1787733926.330908:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733926.517035:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733926.517090:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733926.517125:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689974016 00000100:00100000:2.0:1787733926.517136:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689974016 00000100:00080000:3.0:1787733926.517206:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733926.517259:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689974144 00000100:00100000:2.0:1787733926.517262:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689974144 00000100:00100000:2.0:1787733926.517292:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:2.0:1787733926.517300:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689974016:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733926.517357:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:0.0:1787733926.517374:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574689974144:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:1.0:1787733926.517380:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733926.517530:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689974016:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 229us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733926.517537:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:3.0:1787733926.518708:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574689974144:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 1338us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733926.518715:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:0.0:1787733926.717928:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705736832:0@lo:400:kworker.0 00000100:00100000:0.0:1787733926.718007:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733926.718083:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787733926.718092:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705736448:0@lo:400:kworker.0 00000100:00100000:0.0:1787733926.718115:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733926.718133:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705736960:0@lo:400:kworker.0 00000100:00100000:0.0:1787733926.718178:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733926.718212:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705736576:0@lo:400:kworker.0 00000100:00100000:0.0:1787733926.718246:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733926.718265:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787733926.718272:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705736704:0@lo:400:kworker.0 00000100:00100000:0.0:1787733926.718294:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733926.718331:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705736960 00000100:00100000:0.0:1787733926.718338:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705736960 00000100:00100000:0.0:1787733926.718387:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705736704 00000100:00100000:0.0:1787733926.718390:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705736704 00000100:00100000:0.0:1787733926.718412:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787733926.718433:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705736960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733926.718629:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787733926.718640:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefdab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705736704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733926.718685:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefdab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705736704:12345-0@lo:400:kworker.0 Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733926.718692:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787733926.718716:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705736832 00000100:00100000:1.0:1787733926.718720:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705736832 00000100:00100000:1.0:1787733926.718748:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705736448 00000100:00100000:1.0:1787733926.718751:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705736448 00000100:00100000:1.0:1787733926.718763:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705736576 00000100:00100000:1.0:1787733926.718766:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705736576 00000100:00100000:1.0:1787733926.718780:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787733926.718787:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefdaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705736832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733926.718820:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefdaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705736832:12345-0@lo:400:kworker.0 Request processed in 34us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733926.718827:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787733926.718839:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787733926.718845:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705736448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733926.718871:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705736448:12345-0@lo:400:kworker.0 Request processed in 26us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733926.718876:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787733926.718886:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787733926.718892:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705736576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733926.718916:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705736576:12345-0@lo:400:kworker.0 Request processed in 24us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733926.718933:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787733926.719188:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787733926.719192:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787733926.719194:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787733926.719227:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eef788700 x1874574705736704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733926.719248:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705736704:0@lo:400:kworker.0 00000100:00100000:1.0:1787733926.719260:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705736576:0@lo:400:kworker.0 00000100:00100000:1.0:1787733926.719302:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705736448:0@lo:400:kworker.0 00000100:00100000:1.0:1787733926.719313:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705736832:0@lo:400:kworker.0 00000100:00100000:0.0:1787733926.719567:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705736960:12345-0@lo:400:kworker.0 Request processed in 1148us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733926.719575:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787733926.719683:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eef789500 x1874574705736960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733926.719693:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705736960:0@lo:400:kworker.0 00000100:00100000:1.0:1787733927.227219:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787733927.227244:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705737088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787733927.227317:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733927.227397:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705737088 00000100:00100000:1.0:1787733927.227406:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705737088 00000100:00100000:1.0:1787733927.227459:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787733927.227468:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705737088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787733927.227504:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733927.227551:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705737088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733927.227558:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787733927.227776:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec60c8380 x1874574705737088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733927.227796:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705737088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787733927.354400:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787733927.427185:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787733927.427210:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ef0329800 from 7 10000000:01000000:3.0:1787733927.427217:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787733927.427264:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733927.427277:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733927.427290:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733927.427316:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6802680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787733927.427390:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733927.427468:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efe973900 going to sleep for 11 seconds 00000100:00100000:1.0:1787733927.427604:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705737216 00000100:00100000:1.0:1787733927.427612:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705737216 00000100:00100000:1.0:1787733927.427669:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787733927.427680:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705737216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787733927.427694:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733927.427708:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cd800/0x45228d86de4d5674 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d566d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.427729:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cd800/0x45228d86de4d5674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d566d expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.427740:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cd800/0x45228d86de4d5674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d566d expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.427750:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cd800, rc 0) 00000100:00100000:1.0:1787733927.427797:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705737216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733927.427804:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787733927.428025:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6802680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733927.428041:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733927.428050:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733927.428109:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef789500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733927.428136:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733927.428180:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee547e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787733927.428321:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705737344 00000100:00100000:3.0:1787733927.428326:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705737344 00000100:00100000:3.0:1787733927.428370:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787733927.428377:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705737344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733927.428860:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705737344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 482us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733927.428867:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787733927.430217:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef789500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733927.430271:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef789500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787733927.430334:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733927.430374:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee547e300 going to sleep for 11 seconds 00000100:00100000:1.0:1787733927.430508:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705737472 00000100:00100000:1.0:1787733927.430515:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705737472 00000100:00100000:1.0:1787733927.430564:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787733927.430572:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705737472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.430749:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705737472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733927.430767:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787733927.430810:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef789500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787733927.431494:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787733927.431544:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787733927.431563:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787733927.431573:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.431584:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733927.431594:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787733927.431597:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec73ed000 from 7 10000000:01000000:1.0:1787733927.431600:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787733927.431628:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.431636:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.431644:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733927.431660:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.431693:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733927.431721:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec63d70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733927.431733:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705737600 00000100:00100000:1.0:1787733927.431737:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705737600 00000100:00100000:1.0:1787733927.431757:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787733927.431772:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705737600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787733927.431783:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733927.431794:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cda00/0x45228d86de4d5682 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d567b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.431817:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cda00/0x45228d86de4d5682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d567b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.431828:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cda00/0x45228d86de4d5682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d567b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.431836:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cda00, rc 0) 00000100:00100000:1.0:1787733927.431869:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705737600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733927.431875:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787733927.431906:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787733927.431917:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.431926:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733927.431963:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.431988:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733927.432001:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec63d70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733927.432011:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705737728 00000100:00100000:1.0:1787733927.432014:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705737728 00000100:00100000:1.0:1787733927.432031:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787733927.432044:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705737728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.432287:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705737728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733927.432310:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787733927.432339:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.432363:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.432396:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733927.432427:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec63d70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733927.432493:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705737856 00000100:00100000:1.0:1787733927.432497:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705737856 00000100:00100000:1.0:1787733927.432513:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787733927.432518:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705737856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.432644:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705737856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733927.432650:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787733927.432685:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787733927.438080:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787733927.438361:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787733927.438383:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787733927.438394:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.438416:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733927.438428:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787733927.438431:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec7b73800 from 7 10000000:01000000:1.0:1787733927.438443:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787733927.438491:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.438500:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.438510:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733927.438533:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.438599:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733927.438645:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec63d70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733927.438750:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705737984 00000100:00100000:2.0:1787733927.438757:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705737984 00000100:00100000:2.0:1787733927.438798:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787733927.438807:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705737984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733927.438820:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733927.438831:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13ca800/0x45228d86de4d5690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5689 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733927.438851:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13ca800/0x45228d86de4d5690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5689 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733927.438860:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13ca800/0x45228d86de4d5690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5689 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733927.438869:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca800, rc 0) 00000100:00100000:2.0:1787733927.438923:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705737984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733927.438930:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787733927.439273:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705737984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787733927.439288:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733927.439297:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733927.439348:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705738112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.439374:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733927.439404:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec63d70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733927.439462:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705738112 00000100:00100000:2.0:1787733927.439467:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705738112 00000100:00100000:2.0:1787733927.439497:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787733927.439503:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705738112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733927.439745:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705738112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733927.439759:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787733927.439883:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705738112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.439908:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705738240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.439943:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733927.439962:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec63d70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733927.439975:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705738240 00000100:00100000:1.0:1787733927.439984:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705738240 00000100:00100000:1.0:1787733927.440000:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787733927.440005:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705738240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733927.440145:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705738240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733927.440180:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787733927.440219:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705738240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787733927.441301:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787733927.441556:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787733927.441573:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787733927.441584:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733927.441594:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733927.739251:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787733927.739274:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705738368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787733927.739345:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733927.739400:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705738368 00000100:00100000:3.0:1787733927.739417:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705738368 00000100:00100000:3.0:1787733927.739457:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787733927.739466:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705738368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787733927.739502:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733927.739548:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705738368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733927.739553:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787733927.739597:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6801180 x1874574705738368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733927.739615:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705738368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733927.993472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733927.993513:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689974272 00000100:00100000:0.0:1787733927.993530:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689974272 00000100:00100000:0.0:1787733927.994732:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 232 00000100:00100000:0.0:1787733927.994747:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:5593:x1874574689974272:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787733927.994766:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733927.994785:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5697 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df193b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733927.994811:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b0 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733927.994822:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b0 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733927.994831:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658a00, rc 0) 00000100:00100000:0.0:1787733927.994893:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689974272:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 151us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733927.994900:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 232 00000100:00100000:3.0:1787733928.011495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733928.011607:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689974400 00000100:00100000:0.0:1787733928.011618:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689974400 00000100:00100000:0.0:1787733928.011680:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 233 00000100:00100000:0.0:1787733928.011691:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689974400:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787733928.011976:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689974400:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 286us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733928.011985:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 233 00000100:00100000:2.0:1787733928.017493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733928.017559:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689974528 00000100:00100000:3.0:1787733928.017569:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689974528 00000100:00100000:3.0:1787733928.017612:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 234 00000100:00100000:3.0:1787733928.017621:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689974528:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733928.017846:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689974528:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 224us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733928.017854:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 234 00000100:00100000:3.0:1787733928.025418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733928.025623:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689974656 00000100:00100000:2.0:1787733928.025632:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689974656 00000100:00100000:2.0:1787733928.025677:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 235 00000100:00100000:2.0:1787733928.025685:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689974656:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733928.025700:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733928.025714:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13ca600/0x45228d86de4d569e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df193b7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733928.025737:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13ca600/0x45228d86de4d569e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b7 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733928.025745:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13ca600/0x45228d86de4d569e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b7 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733928.025752:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca600, rc 0) 00000100:00100000:2.0:1787733928.025799:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:5593:x1874574689974656:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 115us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733928.025804:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 235 00000100:00100000:2.0:1787733928.036249:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733928.036330:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689974784 00000100:00100000:3.0:1787733928.036340:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689974784 00000100:00100000:3.0:1787733928.036393:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 236 00000100:00100000:3.0:1787733928.036412:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:5593:x1874574689974784:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733928.036775:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:5593:x1874574689974784:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 364us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733928.036785:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 236 00000100:00100000:2.0:1787733928.038753:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733928.038827:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689974912 00000100:00100000:3.0:1787733928.038837:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689974912 00000100:00100000:3.0:1787733928.038884:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:3.0:1787733928.038894:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:5593:x1874574689974912:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733928.039175:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:5593:x1874574689974912:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 281us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733928.039183:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 237 00010000:00010000:1.0:1787733928.382122:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733929.403441:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787733929.466603:0:11353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787733930.427826:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733931.450670:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733931.639570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733931.639647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733931.639680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733931.639780:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689975296 00000100:00100000:0.0:1787733931.639790:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689975296 00000100:00100000:0.0:1787733931.639853:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689975168 00000100:00100000:0.0:1787733931.639871:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689975168 00000100:00100000:0.0:1787733931.639905:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:0.0:1787733931.639916:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574689975296:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733931.639992:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574689975296:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 78us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733931.639999:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:0.0:1787733931.640017:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:0.0:1787733931.640024:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689975168:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733931.640049:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689975168:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733931.640056:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00080000:2.0:1787733931.640228:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733931.640577:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689975040 00000100:00100000:3.0:1787733931.640583:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689975040 00000100:00100000:3.0:1787733931.640655:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00100000:3.0:1787733931.640664:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574689975040:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733931.640710:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574689975040:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 49us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733931.640715:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00100000:1.0:1787733931.837014:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705738496:0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.837095:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733931.837136:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705738752:0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.837172:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705739008:0@lo:400:kworker.0 00000100:00100000:2.0:1787733931.837189:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733931.837199:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705738880:0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.837223:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733931.837229:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705738624:0@lo:400:kworker.0 00000100:00100000:2.0:1787733931.837251:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733931.837268:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705739136:0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.837275:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705738496 00000100:00100000:1.0:1787733931.837283:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705738496 00000100:00100000:2.0:1787733931.837289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733931.837316:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705738880 00000100:00100000:2.0:1787733931.837319:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705738880 00000100:00100000:1.0:1787733931.837326:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787733931.837347:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705738496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733931.837364:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705739136 00000100:00100000:2.0:1787733931.837366:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705739136 00000100:00100000:2.0:1787733931.837386:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787733931.837392:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705738880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.837392:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705738496:12345-0@lo:400:kworker.0 Request processed in 48us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733931.837399:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787733931.837426:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705738880:12345-0@lo:400:kworker.0 Request processed in 34us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733931.837430:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787733931.837434:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787733931.837437:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705739136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.838188:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705739136:12345-0@lo:400:kworker.0 Request processed in 749us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733931.838212:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787733931.838251:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733931.838291:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705738496:0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.838316:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705738752 00000100:00100000:1.0:1787733931.838319:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705738752 00000100:00100000:1.0:1787733931.838357:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705738624 00000100:00100000:1.0:1787733931.838361:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705738624 00000100:00100000:1.0:1787733931.838372:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705739008 00000100:00100000:1.0:1787733931.838375:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705739008 00000100:00100000:1.0:1787733931.838387:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787733931.838393:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705738752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.838432:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705738752:12345-0@lo:400:kworker.0 Request processed in 39us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733931.838438:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787733931.838450:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787733931.838456:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705738624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.838482:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705738624:12345-0@lo:400:kworker.0 Request processed in 26us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733931.838487:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787733931.838497:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787733931.838502:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705739008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.838530:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705739008:12345-0@lo:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733931.838536:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787733931.838566:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705738752:0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.838589:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705739008:0@lo:400:kworker.0 00000100:00080000:1.0:1787733931.838635:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787733931.838639:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787733931.838641:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787733931.838660:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec60c8700 x1874574705738880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733931.838673:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705738880:0@lo:400:kworker.0 00000100:00100000:1.0:1787733931.838704:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705738624:0@lo:400:kworker.0 00010000:00080000:1.0:1787733931.838715:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec60c9880 x1874574705739136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733931.838723:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705739136:0@lo:400:kworker.0 00000100:00100000:0.0:1787733932.348443:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787733932.348467:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefda8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705739264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787733932.348532:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733932.348596:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705739264 00000100:00100000:0.0:1787733932.348604:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705739264 00000100:00100000:0.0:1787733932.348654:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787733932.348664:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705739264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787733932.348702:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787733932.348754:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705739264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733932.348761:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787733932.348837:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eefda8a80 x1874574705739264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733932.348857:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefda8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705739264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787733932.474352:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787733932.521423:0:11453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:45:32 (1787733932) === 00000100:00100000:2.0:1787733932.718578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733932.718672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733932.718799:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689975552 00000100:00100000:3.0:1787733932.718810:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689975552 00000100:00100000:3.0:1787733932.718864:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1787733932.718875:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:9668:x1874574689975552:12345-192.168.201.34@tcp:700:mkdir.0 00000100:00100000:3.0:1787733932.718979:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:9668:x1874574689975552:12345-192.168.201.34@tcp:700:mkdir.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733932.718988:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1787733932.719732:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689975424 00000100:00100000:1.0:1787733932.719741:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689975424 00000100:00100000:1.0:1787733932.719793:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1787733932.719802:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689975424:12345-192.168.201.34@tcp:41:mkdir.0 00000004:00000024:1.0:1787733932.719837:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787733932.719918:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574689975424:12345-192.168.201.34@tcp:41:mkdir.0 Request processed in 118us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733932.719926:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1787733932.723916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733932.724203:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689975808 00000100:00100000:0.0:1787733932.724215:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689975808 00000100:00100000:0.0:1787733932.724271:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1787733932.724281:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:9668:x1874574689975808:12345-192.168.201.34@tcp:36:mkdir.0 00010000:00010000:0.0:1787733932.724364:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733932.724390:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d5586 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19339 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.724411:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771000) 00010000:00010000:0.0:1787733932.724423:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787733932.724749:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.724763:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.724775:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.724786:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.724792:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.724798:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733932.726940:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787733932.731478:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.731492:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56a5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.731500:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.731526:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733932.731531:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.731539:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.731557:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771300) 00010000:00010000:0.0:1787733932.731560:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733932.731565:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.731572:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787733932.731602:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af0786f2 reply state 0000000050f1c4ad transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733932.731613:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787733932.731735:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:9668:x1874574689975808:12345-192.168.201.34@tcp:36:mkdir.0 Request processed in 7451us (7826us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787733932.731745:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:1.0:1787733932.736030:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.736051:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.736069:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.736075:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733932.736079:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.736087:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.736108:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff891ec6771800) 00010000:00010000:1.0:1787733932.736111:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733932.736115:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.736120:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d56ac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733932.743671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733932.743837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689975936 00000100:00100000:1.0:1787733932.743848:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689975936 00000100:00100000:1.0:1787733932.743914:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1787733932.743924:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:9669:x1874574689975936:12345-192.168.201.34@tcp:101:chmod.0 00010000:00010000:1.0:1787733932.743947:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733932.743969:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d56b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df193be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.744035:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d56ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.744058:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d56ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.744068:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d56ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733932.744127:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787733932.744131:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787733932.744206:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d56ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.744233:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d56b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193be expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.744257:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d56ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193be expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.744266:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec28ef100) 00010000:00010000:1.0:1787733932.744269:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787733932.744273:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60ccc00, rc 0) 00000100:00100000:1.0:1787733932.744346:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:9669:x1874574689975936:12345-192.168.201.34@tcp:101:chmod.0 Request processed in 422us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733932.744353:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1787733932.746906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733932.747002:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689976192 00000100:00100000:1.0:1787733932.747012:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689976192 00000100:00100000:1.0:1787733932.747067:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1787733932.747077:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefdaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:9669:x1874574689976192:12345-192.168.201.34@tcp:36:chmod.0 00010000:00010000:1.0:1787733932.747126:0:8190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733932.747192:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d56ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193be expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.747216:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec28ef100) 00010000:00010000:1.0:1787733932.747227:0:8190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733932.747250:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.747262:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.747271:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733932.747574:0:8190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b500e726 reply state 00000000f91be218 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733932.747584:0:8190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787733932.747596:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787733932.747661:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefdaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:9669:x1874574689976192:12345-192.168.201.34@tcp:36:chmod.0 Request processed in 584us (766us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787733932.747667:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00010000:00010000:0.0:1787733932.749844:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.749860:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.749867:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.749884:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733932.749889:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.749896:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.749912:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec28ef700) 00010000:00010000:0.0:1787733932.749916:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787733932.749920:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.749925:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56c1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733932.767616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733932.767714:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689976320 00000100:00100000:1.0:1787733932.767724:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689976320 00000100:00100000:1.0:1787733932.767792:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1787733932.767804:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:9670:x1874574689976320:12345-192.168.201.34@tcp:101:chown.0 00010000:00010000:1.0:1787733932.767828:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733932.767847:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d56c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df193c5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.767921:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d56cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.767934:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d56cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.767958:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d56cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733932.768022:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787733932.768025:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787733932.768056:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d56cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.768076:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d56c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193c5 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.768093:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d56cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193c5 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.768099:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec28ef100) 00010000:00010000:1.0:1787733932.768101:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787733932.768104:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cca00, rc 0) 00000100:00100000:1.0:1787733932.768151:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:9670:x1874574689976320:12345-192.168.201.34@tcp:101:chown.0 Request processed in 351us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733932.768194:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1787733932.771823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733932.771965:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689976448 00000100:00100000:1.0:1787733932.771974:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689976448 00000100:00100000:1.0:1787733932.772601:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1787733932.772613:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:9670:x1874574689976448:12345-192.168.201.34@tcp:101:chown.0 00010000:00010000:1.0:1787733932.772634:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733932.772655:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d56d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df193cc expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.772733:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.772747:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.772757:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.772772:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.772779:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.772786:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.772891:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d56eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.772898:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d56eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.772905:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d56eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733932.772965:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787733932.772969:0:8190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787733932.773008:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d56eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773022:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773027:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773034:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773040:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733932.773045:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773053:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773066:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec28ef100) 00010000:00010000:1.0:1787733932.773069:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733932.773074:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773079:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773092:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773110:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773116:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773121:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733932.773135:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773142:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773150:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff891ec28ef600) 00010000:00010000:1.0:1787733932.773203:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733932.773207:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773214:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d56e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773250:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d56d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193cc expref: 10 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773263:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d56eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193cc expref: 9 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.773270:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28ef300) 00010000:00010000:1.0:1787733932.773273:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787733932.773281:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cdc00, rc 0) 00000100:00100000:1.0:1787733932.773368:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:9670:x1874574689976448:12345-192.168.201.34@tcp:101:chown.0 Request processed in 757us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733932.773376:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1787733932.778455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733932.778545:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689976704 00000100:00100000:1.0:1787733932.778560:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689976704 00000100:00100000:1.0:1787733932.778635:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:1.0:1787733932.778647:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:9670:x1874574689976704:12345-192.168.201.34@tcp:36:chown.0 00010000:00010000:1.0:1787733932.778705:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733932.778733:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d56eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193cc expref: 9 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.778754:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28ef300) 00010000:00010000:1.0:1787733932.778766:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733932.778794:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.778808:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.778817:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733932.828501:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dd26f36 reply state 0000000009cde7b3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733932.828523:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787733932.828663:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000001:00080000:0.0:1787733932.828788:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1787733932.828800:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00080000:1.0:1787733932.832378:0:5833:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787733932.832412:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:9670:x1874574689976704:12345-192.168.201.34@tcp:36:chown.0 Request processed in 53759us (53969us total) trans 4294967299 rc 0/0 00010000:00010000:2.0:1787733932.832438:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733932.832446:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00010000:00010000:2.0:1787733932.832453:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.832460:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.832465:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733932.832469:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.832474:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.832489:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28efa00) 00010000:00010000:2.0:1787733932.832491:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787733932.832494:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.832498:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d56f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733932.854751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733932.855099:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689976832 00000100:00100000:0.0:1787733932.855108:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689976832 00000100:00100000:0.0:1787733932.855237:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1787733932.855246:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:9671:x1874574689976832:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:0.0:1787733932.855270:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733932.855300:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df193d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733932.858466:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705739392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787733932.858547:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733932.858710:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705739392 00000100:00100000:0.0:1787733932.858718:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705739392 00000100:00100000:0.0:1787733932.858771:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787733932.858786:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705739392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787733932.858821:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000004:00080000:1.0:1787733932.858834:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3467us 00000100:00100000:0.0:1787733932.858956:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705739392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733932.858962:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787733932.858998:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c7bb80 x1874574705739392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733932.859027:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705739392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787733932.887494:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5700 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.887531:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.887545:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.887562:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5707 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.887568:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.887573:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.887981:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d570e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.887990:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d570e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888004:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d570e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733932.888093:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787733932.888098:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787733932.888251:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d570e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888265:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888271:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5700 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888279:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5700 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888285:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cdc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733932.888290:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5700 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888296:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5700 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888309:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec28ef100) 00010000:00010000:1.0:1787733932.888323:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733932.888329:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888336:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888359:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888366:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5707 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888372:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888377:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60ccc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733932.888380:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888387:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5707 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888395:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff891ec28ef900) 00010000:00010000:1.0:1787733932.888397:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733932.888401:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5707 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888407:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5707 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888445:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d56f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193d3 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888456:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d570e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193d3 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.888470:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28ef300) 00010000:00010000:1.0:1787733932.888472:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787733932.888474:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc200, rc 0) 00000100:00100000:1.0:1787733932.888551:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:9671:x1874574689976832:12345-192.168.201.34@tcp:101:touch.500 Request processed in 33304us (33816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733932.888562:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1787733932.901815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733932.905518:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689977088 00000100:00100000:2.0:1787733932.905538:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689977088 00000100:00100000:2.0:1787733932.905673:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:2.0:1787733932.905685:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:9671:x1874574689977088:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:2.0:1787733932.905707:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733932.905730:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5715 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df193da expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.910432:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d571c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.910462:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d571c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.910475:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d571c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.910492:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.910499:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.910505:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787733932.911714:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787733932.917743:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d572a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.917771:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d572a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.917783:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d572a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.917841:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d571c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.917870:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d571c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.917877:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d571c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.917884:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733932.917888:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d571c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.917896:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d571c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.917910:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28ef300) 00010000:00010000:2.0:1787733932.917913:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733932.917918:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d571c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.917924:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d571c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787733932.917943:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4db5ed0 reply state 000000001d9eb9b9 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733932.918294:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787733932.918350:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5715 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193da expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.918367:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d572a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193da expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733932.918388:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891ed3d91300) 00010000:00010000:2.0:1787733932.918391:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787733932.918394:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca200, rc 0) 00000100:00100000:2.0:1787733932.918480:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:9671:x1874574689977088:12345-192.168.201.34@tcp:101:touch.500 Request processed in 12796us (16748us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787733932.918490:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00010000:00010000:1.0:1787733932.924702:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.924724:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.924732:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.924739:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13caa00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733932.924744:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.924752:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.924770:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe9837317 (ffff891ed3d91200) 00010000:00010000:1.0:1787733932.924773:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733932.924779:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.924785:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5723 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733932.933475:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733932.933534:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689977344 00000100:00100000:1.0:1787733932.933544:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689977344 00000100:00100000:1.0:1787733932.933599:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:1.0:1787733932.933611:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:9671:x1874574689977344:12345-192.168.201.34@tcp:36:touch.500 00010000:00010000:1.0:1787733932.933672:0:8190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733932.933697:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d572a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193da expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.933712:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891ed3d91300) 00010000:00010000:1.0:1787733932.933720:0:8190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733932.933754:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.933763:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733932.933769:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733932.933878:0:8190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031282ae5 reply state 0000000045a055db transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733932.933885:0:8190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787733932.934127:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:9671:x1874574689977344:12345-192.168.201.34@tcp:36:touch.500 Request processed in 518us (661us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787733932.934132:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00010000:00010000:0.0:1787733932.937039:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.937058:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.937066:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.937072:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60ccc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733932.937077:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.937085:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.937114:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891ec28ef900) 00010000:00010000:0.0:1787733932.937117:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733932.937122:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.937129:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5738 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733932.937354:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733932.937755:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689977472 00000100:00100000:0.0:1787733932.937767:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689977472 00000100:00100000:0.0:1787733932.937849:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:0.0:1787733932.937861:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:9671:x1874574689977472:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:0.0:1787733932.937888:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733932.938090:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d573f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df193e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.938434:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d573f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193e1 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.938449:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d573f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193e1 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733932.938468:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891ec6771000) 00010000:00010000:0.0:1787733932.938472:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787733932.938476:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659200, rc 0) 00000100:00100000:0.0:1787733932.938554:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:9671:x1874574689977472:12345-192.168.201.34@tcp:101:touch.500 Request processed in 696us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733932.938562:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:2.0:1787733932.942356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733932.942695:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689977600 00000100:00100000:1.0:1787733932.942706:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689977600 00000100:00100000:1.0:1787733932.942765:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1787733932.942774:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1874574689977600:12345-192.168.201.34@tcp:8:touch.500 00010000:00080000:1.0:1787733932.942809:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:1.0:1787733932.942839:0:6681:0:(genops.c:1385:class_connect()) connect: client a2c26bfa-a021-441a-9db5-0c3742b5640d, cookie 0x45228d86de4d5746 00002000:00100000:1.0:1787733932.942851:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a2c26bfa-a021-441a-9db5-0c3742b5640d/ffff891efe87f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787733932.942862:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787733932.943744:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787733932.943785:0:6681:0:(import.c:65:import_set_state_nolock()) ffff891efe87a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787733932.943932:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2353:x1874574689977600:12345-192.168.201.34@tcp:8:touch.500 Request processed in 1147us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733932.943942:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1787733932.947892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733932.948887:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689977728 00000100:00100000:2.0:1787733932.948903:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689977728 00000100:00080000:1.0:1787733932.949060:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787733932.949379:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:2.0:1787733932.949393:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:0:x1874574689977728:12345-192.168.201.34@tcp:2:touch.500 00000001:00100000:1.0:1787733933.002495:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000001:00080000:1.0:1787733933.002518:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1787733933.002734:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:0:x1874574689977728:12345-192.168.201.34@tcp:2:touch.500 Request processed in 53335us (54845us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787733933.002748:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:2.0:1787733933.005475:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733933.005678:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689977984 00000100:00100000:0.0:1787733933.005690:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689977984 00000100:00100000:0.0:1787733933.005785:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:0.0:1787733933.005801:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:9671:x1874574689977984:12345-192.168.201.34@tcp:35:touch.500 00000100:00100000:0.0:1787733933.006270:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+11:9671:x1874574689977984:12345-192.168.201.34@tcp:35:touch.500 Request processed in 474us (804us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787733933.006298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00080000:1.0:1787733933.006926:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733933.024947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733933.025066:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689978112 00000100:00100000:0.0:1787733933.025081:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689978112 00000100:00100000:0.0:1787733933.025259:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1787733933.025273:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+11:9672:x1874574689978112:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:0.0:1787733933.025321:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733933.025350:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d574d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df193e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.025439:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.025457:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.025474:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733933.025550:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787733933.025555:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733933.025602:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.025634:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d574d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193e8 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.025657:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193e8 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.025688:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28ef300) 00010000:00010000:0.0:1787733933.025692:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787733933.025697:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658800, rc 0) 00000100:00100000:0.0:1787733933.025976:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:9672:x1874574689978112:12345-192.168.201.34@tcp:101:rm.0 Request processed in 705us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733933.025985:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1787733933.032887:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733933.033016:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689978368 00000100:00100000:2.0:1787733933.033030:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689978368 00000100:00100000:2.0:1787733933.033442:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1787733933.033457:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:9672:x1874574689978368:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:2.0:1787733933.033485:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733933.033514:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d575b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df193ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733933.033672:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787733933.033913:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d575b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193ef expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.033945:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec28ef100) 00010000:00010000:2.0:1787733933.033948:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787733933.033956:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d575b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193ef expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.033975:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca000, rc 0) 00000100:00100000:2.0:1787733933.034137:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:9672:x1874574689978368:12345-192.168.201.34@tcp:101:rm.0 Request processed in 682us (1263us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787733933.034146:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1787733933.039920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733933.040022:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689978496 00000100:00100000:0.0:1787733933.040040:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689978496 00000100:00100000:0.0:1787733933.040113:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1787733933.040135:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:9672:x1874574689978496:12345-192.168.201.34@tcp:37:rm.0 00000100:00100000:1.0:1787733933.045532:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:9672:x1874574689978496:12345-192.168.201.34@tcp:37:rm.0 Request processed in 5395us (5611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733933.045547:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1787733933.049236:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733933.049407:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689978752 00000100:00100000:3.0:1787733933.049420:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689978752 00000100:00100000:3.0:1787733933.049492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1787733933.049505:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec73d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:9672:x1874574689978752:12345-192.168.201.34@tcp:35:rm.0 00000100:00100000:3.0:1787733933.049966:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec73d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:9672:x1874574689978752:12345-192.168.201.34@tcp:35:rm.0 Request processed in 462us (741us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787733933.049975:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:2.0:1787733933.069524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733933.069643:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689979008 00000100:00100000:1.0:1787733933.069658:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689979008 00000100:00100000:1.0:1787733933.069800:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:1.0:1787733933.069813:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:9672:x1874574689979008:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:1.0:1787733933.069846:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733933.069873:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df193f6 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.070076:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5770 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.070095:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.070106:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733933.070130:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787733933.070357:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193f6 expref: 17 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.070381:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193f6 expref: 16 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.070390:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28ef300) 00010000:00010000:1.0:1787733933.070394:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787733933.070398:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc000, rc 0) 00000100:00100000:1.0:1787733933.070471:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:9672:x1874574689979008:12345-192.168.201.34@tcp:101:rm.0 Request processed in 660us (958us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787733933.070480:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:2.0:1787733933.074378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733933.081661:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689979136 00000100:00100000:0.0:1787733933.081689:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689979136 00000100:00100000:0.0:1787733933.081782:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1787733933.081795:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:9672:x1874574689979136:12345-192.168.201.34@tcp:41:rm.0 00000004:00000024:0.0:1787733933.081871:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787733933.081962:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:9672:x1874574689979136:12345-192.168.201.34@tcp:41:rm.0 Request processed in 169us (7595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733933.081970:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:2.0:1787733933.094492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733933.094569:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689979264 00000100:00100000:0.0:1787733933.094581:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689979264 00000100:00100000:0.0:1787733933.094637:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:0.0:1787733933.094650:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:9672:x1874574689979264:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:0.0:1787733933.094703:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733933.094728:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d577e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df193fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.094960:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5785 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.094979:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5785 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.094992:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5785 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095010:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d578c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe9837317 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095015:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d578c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095020:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d578c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095286:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095296:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095304:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733933.095347:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787733933.095359:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733933.095793:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095806:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095813:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5785 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095817:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5785 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095823:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5785 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095827:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733933.095830:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5785 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095835:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5785 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095844:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28ef300) 00010000:00010000:0.0:1787733933.095847:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733933.095851:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5785 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095856:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5785 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095866:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d578c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095878:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d578c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095882:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d578c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095885:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733933.095886:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d578c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095890:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d578c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095894:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe9837317 (ffff891ec6771300) 00010000:00010000:0.0:1787733933.095895:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733933.095896:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d578c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095899:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d578c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095928:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d577e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193fd expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095938:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193fd expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733933.095944:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891ec6771000) 00010000:00010000:0.0:1787733933.095945:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733933.095955:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659400, rc 0) 00000100:00100000:0.0:1787733933.096034:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+17:9672:x1874574689979264:12345-192.168.201.34@tcp:101:rm.0 Request processed in 1382us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733933.096043:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:0.0:1787733933.117443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733933.117561:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689979520 00000100:00100000:1.0:1787733933.117574:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689979520 00000100:00100000:1.0:1787733933.117649:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:1.0:1787733933.117661:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+17:9672:x1874574689979520:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:1.0:1787733933.117752:0:8190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787733933.117799:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193fd expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.117825:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d573f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193e1 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.117837:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891ec6771000) 00010000:00010000:1.0:1787733933.117857:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193e8 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.117868:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28ef300) 00010000:00010000:1.0:1787733933.117872:0:8190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733933.117899:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d579a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.117915:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d579a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.117926:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d579a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.117943:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.117950:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.117957:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.118101:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d57a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.118116:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d57a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.118123:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d57a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787733933.124434:0:8190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787733933.124465:0:8190:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 251113307659ns, next at 252113301750ns, rc = 0 00010000:00010000:1.0:1787733933.124575:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124592:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124603:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124610:0:8190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124615:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124619:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124640:0:8190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787733933.124665:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d57a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124668:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d57a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124693:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d57a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124698:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733933.124702:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d57a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124708:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d57a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124718:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891ec28efd00) 00010000:00010000:1.0:1787733933.124721:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787733933.124724:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d57a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124728:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d57a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124753:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d579a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124757:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d579a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124760:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d579a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124764:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cdc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733933.124766:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d579a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124776:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d579a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124781:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28ef300) 00010000:00010000:1.0:1787733933.124783:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733933.124785:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d579a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.124788:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d579a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733933.124796:0:8190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c79da55 reply state 000000001d78b4c0 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733933.124803:0:8190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787733933.124909:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:9672:x1874574689979520:12345-192.168.201.34@tcp:36:rm.0 Request processed in 7245us (7487us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787733933.124920:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00010000:00010000:2.0:1787733933.125380:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787733933.125389:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.125396:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cce00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787733933.125401:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.125408:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.125418:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891ec28efd00) 00010000:00010000:2.0:1787733933.125420:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787733933.125435:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.125455:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d57af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.125479:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733933.125482:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733933.125484:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733933.130670:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.130700:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.130709:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.130716:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733933.130723:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.130763:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.130786:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe9837317 (ffff891ec28ef600) 00010000:00010000:1.0:1787733933.130790:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733933.130796:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.130804:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d57a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe9837317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733933.133663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733933.133917:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689979776 00000100:00100000:3.0:1787733933.133932:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689979776 00000100:00100000:3.0:1787733933.134017:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1787733933.134032:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:9672:x1874574689979776:12345-192.168.201.34@tcp:35:rm.0 00000100:00100000:3.0:1787733933.134728:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:9672:x1874574689979776:12345-192.168.201.34@tcp:35:rm.0 Request processed in 697us (1075us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787733933.134738:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1787733933.138580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733933.138950:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689980032 00000100:00100000:2.0:1787733933.138964:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689980032 00000100:00100000:2.0:1787733933.139046:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:2.0:1787733933.139060:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:9672:x1874574689980032:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:2.0:1787733933.139414:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787733933.139571:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193f6 expref: 16 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.139604:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d570e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193d3 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.139618:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ec28ef300) 00010000:00010000:2.0:1787733933.139638:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d56cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193c5 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.139647:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec28ef100) 00010000:00010000:2.0:1787733933.139654:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787733933.139864:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d57b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.139880:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d57b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.139907:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d57b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.139922:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.139930:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.139937:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.141617:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d57c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.141637:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d57c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.141648:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d57c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733933.144247:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787733933.144277:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d57c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144442:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d57c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144451:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d57c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144457:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733933.144472:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d57c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144481:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d57c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144501:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891ed3d91300) 00010000:00010000:2.0:1787733933.144504:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787733933.144510:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d57c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144517:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d57c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144549:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d57b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144556:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d57b6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144561:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d57b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144567:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733933.144569:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d57b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144576:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d57b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144584:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ed3d91500) 00010000:00010000:2.0:1787733933.144587:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733933.144599:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d57b6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.144606:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d57b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787733933.144621:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000656b3992 reply state 00000000c8aafb67 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733933.144631:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787733933.145103:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:9672:x1874574689980032:12345-192.168.201.34@tcp:36:rm.0 Request processed in 6039us (6529us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787733933.145113:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00010000:00010000:2.0:1787733933.154579:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.154600:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.154609:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.154616:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733933.154621:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.154631:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.154654:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff891ed3d91800) 00010000:00010000:2.0:1787733933.154658:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733933.154664:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733933.155249:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca200/0x45228d86de4d57bd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733933.498861:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733934.529470:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733935.546402:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733936.575548:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787733936.576145:0:11603:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1787733936.756425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733936.756464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733936.756490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733936.756510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733936.756521:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689980160 00000100:00100000:3.0:1787733936.756532:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689980288 00000100:00100000:1.0:1787733936.756533:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689980160 00000100:00100000:3.0:1787733936.756537:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689980288 00000100:00100000:3.0:1787733936.756586:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689980544 00000100:00100000:3.0:1787733936.756588:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689980544 00000100:00100000:1.0:1787733936.756599:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 240 00000100:00100000:3.0:1787733936.756612:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:1.0:1787733936.756615:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2356:x1874574689980160:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733936.756622:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:2356:x1874574689980288:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733936.756683:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:2356:x1874574689980288:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 64us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733936.756689:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:3.0:1787733936.756705:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:2.0:1787733936.756706:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689980416 00000100:00100000:1.0:1787733936.756711:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2356:x1874574689980160:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733936.756714:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689980416 00000100:00100000:3.0:1787733936.756717:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2356:x1874574689980544:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733936.756730:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 240 00000100:00100000:3.0:1787733936.756745:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2356:x1874574689980544:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 30us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733936.756750:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:2.0:1787733936.756765:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1787733936.756778:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574689980416:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:1.0:1787733936.756778:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787733936.756785:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733936.756819:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574689980416:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 45us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733936.756827:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:1.0:1787733936.954529:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705739520:0@lo:400:kworker.0 00000100:00100000:3.0:1787733936.954534:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787733936.954552:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874574705739776:0@lo:400:kworker.0 00000100:00100000:1.0:1787733936.954598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733936.954604:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733936.954653:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733936.954660:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705739648:0@lo:400:kworker.0 00000100:00100000:1.0:1787733936.954684:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733936.954730:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705739776 00000100:00100000:1.0:1787733936.954732:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705739520 00000100:00100000:2.0:1787733936.954741:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705739776 00000100:00100000:1.0:1787733936.954741:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705739520 00000100:00100000:1.0:1787733936.954782:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787733936.954791:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705739520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733936.954792:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705739648 00000100:00100000:2.0:1787733936.954798:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705739648 00000100:00100000:2.0:1787733936.954821:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787733936.954830:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874574705739776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733936.954855:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705739520:12345-0@lo:400:kworker.0 Request processed in 54us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733936.954864:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787733936.954874:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874574705739776:12345-0@lo:400:kworker.0 Request processed in 45us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733936.954882:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787733936.954898:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787733936.954905:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705739648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733936.954925:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705739520:0@lo:400:kworker.0 00000100:00100000:2.0:1787733936.954933:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705739648:12345-0@lo:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733936.954940:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1787733936.954962:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733936.954966:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705739648:0@lo:400:kworker.0 00000100:00100000:3.0:1787733936.954967:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874574705739776:0@lo:400:kworker.0 00000100:00100000:3.0:1787733936.955102:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787733936.955113:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705740032:0@lo:400:kworker.0 00000100:00100000:1.0:1787733936.955120:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705739904:0@lo:400:kworker.0 00000100:00100000:1.0:1787733936.955180:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733936.955191:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733936.955232:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705739904 00000100:00100000:2.0:1787733936.955237:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705739904 00000100:00100000:1.0:1787733936.955287:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705740160:0@lo:400:kworker.0 00000100:00100000:3.0:1787733936.955296:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705740032 00000100:00100000:3.0:1787733936.955303:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705740032 00000100:00100000:1.0:1787733936.955314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733936.956442:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705740160 00000100:00100000:1.0:1787733936.956448:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705740160 00000100:00100000:1.0:1787733936.956480:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787733936.956508:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787733936.956570:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787733936.956581:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705740160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733936.956588:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705740032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733936.956635:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705739904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733936.956710:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705740160:12345-0@lo:400:kworker.0 Request processed in 132us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733936.956718:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787733936.956746:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787733936.956749:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787733936.956752:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787733936.956774:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ed2005c00 x1874574705740160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733936.956785:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705740032:12345-0@lo:400:kworker.0 Request processed in 202us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733936.956788:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705740160:0@lo:400:kworker.0 00000100:00100000:3.0:1787733936.956800:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787733936.956808:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705740032:0@lo:400:kworker.0 00000100:00100000:1.0:1787733936.956941:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705739904:12345-0@lo:400:kworker.0 Request processed in 454us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733936.956948:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787733936.956999:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ed2005500 x1874574705739904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733936.957010:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705739904:0@lo:400:kworker.0 00000020:00000080:0.0:1787733937.249480:0:11651:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff08208d20 20000000:00000080:0.0:1787733937.249495:0:11651:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff891efe811800 uarg=0000000000000000 20000000:01000000:0.0:1787733937.249522:0:11651:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787733937.249526:0:11651:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787733937.249530:0:11651:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787733937.250095:0:11652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787733937.250355:0:11651:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787733937.253823:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787733937.253878:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787733937.253927:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787733937.253943:0:11651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787733937.253963:0:11651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.253981:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec60cd800/0x45228d86de4d5674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d566d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.253990:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec60cda00/0x45228d86de4d5682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d567b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.253997:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec13ca800/0x45228d86de4d5690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5689 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.254013:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b0 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.254021:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec13ca600/0x45228d86de4d569e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b7 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.254029:0:11651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.254066:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec13ca600/0x45228d86de4d569e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b7 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.254082:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec13ca600/0x45228d86de4d569e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b7 expref: 12 pid: 5826 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733937.254096:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874574705740288:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733937.254395:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b0 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.254405:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b0 expref: 12 pid: 5825 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733937.254414:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874574705740416:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733937.254455:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec13ca800/0x45228d86de4d5690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d5689 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.254465:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec13ca800/0x45228d86de4d5690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d5689 expref: 18 pid: 5825 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733937.254486:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874574705740544:0@lo:104: 00000100:00100000:2.0:1787733937.254519:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787733937.254551:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec60cda00/0x45228d86de4d5682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d567b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733937.254554:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705740544 00000100:00100000:1.0:1787733937.254561:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705740544 00010000:00010000:2.0:1787733937.254563:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec60cda00/0x45228d86de4d5682 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d567b expref: 18 pid: 5825 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733937.254573:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874574705740672:0@lo:104: 00000100:00100000:2.0:1787733937.254594:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733937.254600:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787733937.254610:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:11651:x1874574705740544:12345-0@lo:104: 00010000:00010000:2.0:1787733937.254612:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec60cd800/0x45228d86de4d5674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d566d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733937.254620:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733937.254623:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891ec60cd800/0x45228d86de4d5674 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d566d expref: 18 pid: 5826 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733937.254642:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874574705740800:0@lo:104: 00000100:00100000:2.0:1787733937.255082:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787733937.255094:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787733937.255097:0:11651:0:(client.c:2715:ptlrpc_set_wait()) set ffff891eed1a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733937.255102:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:11651:x1874574705740544:12345-0@lo:104: Request processed in 493us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733937.255109:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787733937.255123:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874574705740544:0@lo:104: 00000100:00100000:1.0:1787733937.255135:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787733937.255146:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705740672 00000100:00100000:1.0:1787733937.255150:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705740672 00000100:00100000:1.0:1787733937.255187:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705740800 00000100:00100000:1.0:1787733937.255190:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705740800 00010000:00010000:3.0:1787733937.255192:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787733937.255200:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733937.255200:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787733937.255207:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+4:11651:x1874574705740672:12345-0@lo:104: 00010000:00010000:3.0:1787733937.255217:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc600 already unused, calling callback (ffffffffc1b18c20) 00010000:00010000:1.0:1787733937.255218:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733937.255222:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.255246:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733937.255254:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733937.255261:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787733937.255293:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787733937.255296:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733937.255300:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+4:11651:x1874574705740672:12345-0@lo:104: Request processed in 93us (705us total) trans 0 rc 0/0 00010000:00010000:3.0:1787733937.255312:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787733937.255313:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787733937.255329:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787733937.255337:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:11651:x1874574705740800:12345-0@lo:104: 00000100:00100000:0.0:1787733937.255337:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874574705740672:0@lo:104: 00010000:00010000:3.0:1787733937.255338:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733937.255350:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.255353:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec60cc600/0x45228d86de4d5689 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5690 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.255376:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787733937.255379:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.255385:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd000 already unused, calling callback (ffffffffc1b18c20) 00010000:00010000:1.0:1787733937.255394:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1787733937.255395:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733937.255401:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:df19622b-ae94-4c8d-b052-574898624480+3:11651:x1874574705740800:12345-0@lo:104: Request processed in 66us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733937.255413:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787733937.255414:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787733937.255427:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787733937.255433:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787733937.255452:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733937.255459:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874574705740800:0@lo:104: 00010000:00010000:3.0:1787733937.255460:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787733937.255463:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787733937.255470:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.255472:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733937.255486:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ed600 already unused, calling callback (ffffffffc1b18c20) 00010000:00010000:3.0:1787733937.255489:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec60cd000/0x45228d86de4d567b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5682 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787733937.255490:0:11155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733937.255506:0:11155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787733937.255512:0:11155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.255514:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787733937.255515:0:11155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787733937.255517:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733937.255521:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733937.255531:0:11155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733937.255536:0:11155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787733937.255556:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733937.255560:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891efe7ed600/0x45228d86de4d566d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d5674 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733937.255573:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733937.255575:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733937.255577:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733937.255579:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705741184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787733937.255584:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733937.255611:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705740928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787733937.255632:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733937.255652:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705741056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787733937.255676:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705741184 00000100:00100000:1.0:1787733937.255680:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705741184 00000100:00100000:3.0:1787733937.255695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733937.255732:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705741056 00000100:00100000:3.0:1787733937.255736:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705741056 00010000:00010000:3.0:1787733937.255752:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec60cda00/0x45228d86de4d5682 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d567b expref: 20 pid: 5825 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733937.255755:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec60cd800/0x45228d86de4d5674 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d566d expref: 20 pid: 5826 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733937.255795:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787733937.255802:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+20:3312:x1874574705741184:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787733937.255806:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1787733937.255813:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787733937.255819:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+20:3311:x1874574705741056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787733937.255821:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec60cd800/0x45228d86de4d5674 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d566d expref: 20 pid: 5826 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.255832:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733937.255836:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec60cd800/0x45228d86de4d5674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d566d expref: 20 pid: 5826 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.255839:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec60cda00/0x45228d86de4d5682 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d567b expref: 20 pid: 5825 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733937.255860:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec60cd800/0x45228d86de4d5674 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d566d expref: 20 pid: 5826 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.255869:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec60cda00/0x45228d86de4d5682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d567b expref: 20 pid: 5825 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733937.256076:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733937.256081:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec60cda00/0x45228d86de4d5682 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d567b expref: 19 pid: 5825 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.256093:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733937.256124:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+18:3312:x1874574705741184:12345-0@lo:103:ldlm_bl.0 Request processed in 321us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733937.256132:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+18:3311:x1874574705741056:12345-0@lo:103:ldlm_bl.0 Request processed in 317us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733937.256134:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787733937.256144:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787733937.256182:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705741184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787733937.256199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733937.256252:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705740928 00000100:00100000:3.0:1787733937.256256:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705740928 00010000:00010000:3.0:1787733937.256514:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec13ca800/0x45228d86de4d5690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5689 expref: 17 pid: 5825 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733937.256537:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787733937.256544:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+17:3310:x1874574705740928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787733937.256551:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733937.256557:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec13ca800/0x45228d86de4d5690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d5689 expref: 17 pid: 5825 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.256576:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec13ca800/0x45228d86de4d5690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d5689 expref: 17 pid: 5825 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.256587:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13ca800/0x45228d86de4d5690 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d5689 expref: 17 pid: 5825 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.256596:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733937.256632:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+16:3310:x1874574705740928:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733937.256638:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787733937.256684:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705741056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787733937.256794:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705740928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787733937.256930:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874574705740288:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787733937.257992:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874574705740416:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733937.258032:0:11651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733937.258141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733937.258198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733937.258209:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689980672 00000100:00100000:0.0:1787733937.258216:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689980672 00000100:00100000:3.0:1787733937.258323:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689980800 00000100:00100000:3.0:1787733937.258327:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689980800 00010000:00010000:3.0:1787733937.258344:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b0 expref: 14 pid: 5825 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733937.258375:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1787733937.258385:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6bb7a2f-8e14-4d78-9208-bab3541e755f+14:2355:x1874574689980800:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733937.258395:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733937.258401:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b0 expref: 14 pid: 5825 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.258423:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b0 expref: 14 pid: 5825 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.258438:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec6658a00/0x45228d86de4d5697 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b0 expref: 14 pid: 5825 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733937.258450:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733937.258497:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574689980800:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 114us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733937.258505:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00010000:00010000:0.0:1787733937.258514:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec13ca600/0x45228d86de4d569e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b7 expref: 13 pid: 5826 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733937.258545:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:0.0:1787733937.258553:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:2355:x1874574689980672:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733937.258560:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733937.258564:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec13ca600/0x45228d86de4d569e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b7 expref: 12 pid: 5826 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258581:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec13ca600/0x45228d86de4d569e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b7 expref: 12 pid: 5826 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258590:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13ca600/0x45228d86de4d569e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df193b7 expref: 12 pid: 5826 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258607:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258614:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258626:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258630:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258635:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258735:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258744:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787733937.258749:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258757:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258792:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733937.258804:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733937.258823:0:11651:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733937.258829:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:2355:x1874574689980672:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 276us (688us total) trans 0 rc 0/0 00010000:00010000:1.0:1787733937.258837:0:11651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733937.258843:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00010000:00010000:1.0:1787733937.258850:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57cb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733937.469014:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705741312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787733937.469106:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733937.469427:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705741312 00000100:00100000:3.0:1787733937.469444:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705741312 00000100:00100000:3.0:1787733937.469530:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787733937.469540:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705741312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787733937.469577:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733937.479977:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705741312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10425us (10858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733937.479993:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787733937.480553:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c78e00 x1874574705741312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733937.480584:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705741312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787733937.595080:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787733937.983399:0:6726:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 255972239579ns, next at 256972237101ns, rc = 0 00000100:00100000:3.0:1787733937.983421:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787733937.983443:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705741440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787733937.983509:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733937.983582:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705741440 00000100:00100000:3.0:1787733937.983590:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705741440 00000100:00100000:3.0:1787733937.983638:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787733937.983648:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705741440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787733937.983692:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733937.984434:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705741440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 785us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733937.984444:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787733937.984485:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ed2007480 x1874574705741440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733937.984506:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705741440:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787733938.036807:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000001:00080000:1.0:1787733938.037305:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1787733938.037312:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787733938.037497:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1787733938.037768:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705741568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787733938.037836:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733938.038092:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705741568 00000100:00100000:1.0:1787733938.038101:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705741568 00000100:00100000:1.0:1787733938.038302:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787733938.038313:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705741568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787733938.038339:0:6729:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787733938.038374:0:6729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8ea7ad, atime: 0x6a8ea7ad, ctime: 0x6a8ea7ad, blocks: 0x1 00010000:00010000:1.0:1787733938.038383:0:6729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029815013/0x45228d86de4d57d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733938.038401:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=256s v=(0 0) 00010000:00010000:1.0:1787733938.038406:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733938.038412:0:6729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029815013/0x45228d86de4d57d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733938.038430:0:6729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029815013/0x45228d86de4d57d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733938.038459:0:6729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029815013/0x45228d86de4d57d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733938.038467:0:6729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029815013/0x45228d86de4d57d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733938.038485:0:6729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787733938.040178:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874574705741568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1862us (2336us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787733938.040190:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1787733938.040302:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891ed2006a00/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787733938.040308:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705741568:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1787733938.040468:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787733938.040540:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787733938.040547:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029815013/0x45228d86de4d57d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733938.040559:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787733938.040564:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029815013/0x45228d86de4d57d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733938.040575:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029815013/0x45228d86de4d57d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733938.040592:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029815013/0x45228d86de4d57d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733938.040599:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029815013/0x45228d86de4d57d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733938.040633:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733938.040635:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733938.040637:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733938.619347:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733939.194512:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733939.194691:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689980928 00000100:00100000:2.0:1787733939.194702:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689980928 00000100:00100000:2.0:1787733939.194764:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 242 00000100:00100000:2.0:1787733939.194774:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:5593:x1874574689980928:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733939.194792:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733939.194822:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df19404 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733939.194852:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19404 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733939.194864:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19404 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733939.194874:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca200, rc 0) 00000100:00100000:2.0:1787733939.195144:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689980928:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 370us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733939.195185:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 242 00000100:00100000:2.0:1787733939.200796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733939.200895:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689981056 00000100:00100000:1.0:1787733939.200906:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689981056 00000100:00100000:1.0:1787733939.200961:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 243 00000100:00100000:1.0:1787733939.200971:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689981056:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.201316:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689981056:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 346us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733939.201325:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 243 00000100:00100000:3.0:1787733939.215062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733939.216763:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689981184 00000100:00100000:1.0:1787733939.216778:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689981184 00000100:00100000:1.0:1787733939.216859:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 244 00000100:00100000:1.0:1787733939.216870:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689981184:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.219241:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689981184:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 2360us (4175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733939.219257:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 244 00000100:00100000:0.0:1787733939.234905:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733939.235827:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689981312 00000100:00100000:2.0:1787733939.235837:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689981312 00000100:00100000:2.0:1787733939.235953:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 245 00000100:00100000:2.0:1787733939.235965:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:9941:x1874574689981312:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787733939.236252:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:9941:x1874574689981312:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 289us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733939.236260:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 245 00000100:00100000:0.0:1787733939.245959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733939.250932:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689981440 00000100:00100000:1.0:1787733939.250950:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689981440 00000100:00100000:1.0:1787733939.251470:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 246 00000100:00100000:1.0:1787733939.251484:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:9941:x1874574689981440:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787733939.253475:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:9941:x1874574689981440:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 1983us (7513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733939.253504:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 246 10000000:01000000:2.0:1787733939.258418:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787733939.258425:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ef0329800 from 7 10000000:01000000:2.0:1787733939.258430:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787733939.258493:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733939.258506:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733939.258518:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733939.258546:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705741696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787733939.258615:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733939.258676:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705741696 00000100:00100000:2.0:1787733939.258681:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082900 going to sleep for 11 seconds 00000100:00100000:1.0:1787733939.258684:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705741696 00000100:00100000:1.0:1787733939.258736:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787733939.258744:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+16:5829:x1874574705741696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787733939.258757:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733939.258768:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cd800/0x45228d86de4d57e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d57e0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733939.258786:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cd800/0x45228d86de4d57e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d57e0 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733939.258794:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cd800/0x45228d86de4d57e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d57e0 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733939.258800:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cd800, rc 0) 00000100:00100000:1.0:1787733939.258840:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705741696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733939.258845:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787733939.258876:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705741696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787733939.258891:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733939.258900:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733939.258961:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705741824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733939.258987:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733939.259024:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082900 going to sleep for 11 seconds 00000100:00100000:1.0:1787733939.259142:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705741824 00000100:00100000:1.0:1787733939.259146:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705741824 00000100:00100000:1.0:1787733939.259255:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787733939.259263:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705741824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.259525:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705741824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733939.259536:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787733939.259599:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705741824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733939.259628:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705741952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787733939.259666:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733939.259885:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082900 going to sleep for 11 seconds 00000100:00100000:0.0:1787733939.259932:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705741952 00000100:00100000:0.0:1787733939.259937:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705741952 00000100:00100000:0.0:1787733939.259961:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787733939.259968:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705741952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787733939.260184:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705741952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733939.260191:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787733939.260445:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705741952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787733939.267880:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11667:1874574705742080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733939.267970:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733939.268015:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3c8e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787733939.268243:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705742080 00000100:00100000:1.0:1787733939.268259:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705742080 00000100:00100000:1.0:1787733939.268318:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787733939.268328:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+17:11667:x1874574705742080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787733939.268553:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+17:11667:x1874574705742080:12345-0@lo:502:llog_process_th.0 Request processed in 226us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733939.268568:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787733939.270819:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11667:1874574705742080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787733939.270862:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787733939.270870:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733939.270872:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787733939.270877:0:11667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff891ef0329800 00000020:00000080:3.0:1787733939.270880:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787733939.270967:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11667:1874574705742208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733939.271032:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733939.271080:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef836b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787733939.275339:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705742208 00000100:00100000:0.0:1787733939.275351:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705742208 00000100:00100000:0.0:1787733939.275411:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787733939.275422:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:11667:x1874574705742208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733939.275699:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+17:11667:x1874574705742208:12345-0@lo:502:llog_process_th.0 Request processed in 280us (4668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733939.275705:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787733939.275871:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11667:1874574705742208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787733939.276099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733939.276384:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689981568 00000100:00100000:3.0:1787733939.276390:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689981568 00000100:00100000:3.0:1787733939.276433:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 252 00000100:00100000:3.0:1787733939.276442:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:5593:x1874574689981568:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787733939.276452:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733939.276468:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891efe7ed800/0x45228d86de4d57ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df1940b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.276492:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891efe7ed800/0x45228d86de4d57ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1940b expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.276515:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891efe7ed800/0x45228d86de4d57ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1940b expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.276524:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ed800, rc 0) 00000100:00100000:3.0:1787733939.276565:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:5593:x1874574689981568:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 124us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733939.276571:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 252 00000020:01000000:0.0:1787733939.277007:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787733939.277070:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787733939.277073:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787733939.277084:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787733939.277186:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787733939.277221:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787733939.277231:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733939.277240:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787733939.277250:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787733939.277253:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec73ed000 from 7 10000000:01000000:1.0:1787733939.277256:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787733939.277281:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733939.277288:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733939.277296:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733939.277316:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705742336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.277357:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733939.277397:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef83f16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733939.277515:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705742336 00000100:00100000:3.0:1787733939.277521:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705742336 00000100:00100000:3.0:1787733939.277556:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787733939.277565:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+17:5829:x1874574705742336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787733939.277573:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733939.277583:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891efe7ed000/0x45228d86de4d57fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d57f5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.277599:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891efe7ed000/0x45228d86de4d57fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d57f5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.277609:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891efe7ed000/0x45228d86de4d57fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d57f5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.277684:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ed000, rc 0) 00000100:00100000:3.0:1787733939.277716:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705742336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733939.277722:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787733939.277867:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705742336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787733939.277881:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733939.277890:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733939.277938:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705742464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.277963:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733939.277987:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef83f16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733939.278036:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705742464 00000100:00100000:3.0:1787733939.278040:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705742464 00000100:00100000:3.0:1787733939.278078:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787733939.278085:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705742464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787733939.278436:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705742464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733939.278444:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787733939.278519:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705742464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.278546:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705742592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.278582:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733939.278688:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705742592 00000100:00100000:3.0:1787733939.278692:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705742592 00000100:00100000:3.0:1787733939.278711:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787733939.278716:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705742592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.278942:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef83f16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733939.279443:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705742592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 724us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733939.279451:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787733939.279584:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733939.279625:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689981696 00000100:00100000:0.0:1787733939.279630:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689981696 00000100:00100000:0.0:1787733939.279656:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 256 00000100:00100000:0.0:1787733939.279663:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:5593:x1874574689981696:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787733939.279844:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:5593:x1874574689981696:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 180us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733939.279851:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 256 00000100:00100000:1.0:1787733939.282151:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705742592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.283800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733939.283850:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689981824 00000100:00100000:1.0:1787733939.283857:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689981824 00000100:00100000:1.0:1787733939.283903:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 257 00000100:00100000:1.0:1787733939.283916:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:5593:x1874574689981824:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.284132:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:5593:x1874574689981824:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 218us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733939.284140:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 257 00000100:00100000:1.0:1787733939.286913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733939.289088:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11670:1874574705742720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787733939.289181:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733939.289570:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef83f16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733939.293405:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689981952 00000100:00100000:2.0:1787733939.293419:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689981952 00000100:00100000:2.0:1787733939.293472:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705742720 00000100:00100000:2.0:1787733939.293476:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705742720 00000100:00100000:2.0:1787733939.293497:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 258 00000100:00100000:2.0:1787733939.293508:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:9944:x1874574689981952:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787733939.293718:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787733939.293728:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+18:11670:x1874574705742720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787733939.297419:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+18:11670:x1874574705742720:12345-0@lo:502:llog_process_th.0 Request processed in 3684us (8229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733939.297434:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787733939.297751:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11670:1874574705742720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787733939.297791:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787733939.297813:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733939.297815:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787733939.297823:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff891ec73ed000 00000020:00000080:3.0:1787733939.297826:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787733939.297920:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11670:1874574705742848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733939.297968:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733939.297999:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705742848 00000100:00100000:3.0:1787733939.298005:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705742848 00000100:00100000:3.0:1787733939.298332:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787733939.298343:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:11670:x1874574705742848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733939.298496:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+18:11670:x1874574705742848:12345-0@lo:502:llog_process_th.0 Request processed in 154us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733939.298511:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787733939.299747:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3c8e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787733939.299776:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11670:1874574705742848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787733939.299877:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787733939.299885:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787733939.299887:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787733939.299892:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:2.0:1787733939.300794:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:9944:x1874574689981952:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 7283us (13886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733939.300978:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 258 00000100:00100000:2.0:1787733939.305013:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733939.305103:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689982080 00000100:00100000:2.0:1787733939.305113:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689982080 00000040:00080000:1.0:1787733939.306527:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787733939.306982:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 261 00000100:00100000:2.0:1787733939.307005:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:9944:x1874574689982080:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787733939.307311:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:9944:x1874574689982080:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 316us (2306us total) trans 0 rc 0/0 00000020:01000000:0.0:1787733939.307553:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787733939.307579:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787733939.307590:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733939.307601:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787733939.307611:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787733939.307614:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec7b73800 from 7 10000000:01000000:0.0:1787733939.307617:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787733939.308663:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733939.308678:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733939.308699:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733939.308723:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705742976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787733939.308791:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733939.308840:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733939.310107:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705742976 00000100:00100000:3.0:1787733939.310117:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705742976 00000100:00100000:3.0:1787733939.310169:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787733939.310180:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+18:5829:x1874574705742976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787733939.310196:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733939.311022:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891efe7ed200/0x45228d86de4d580a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d5803 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.311054:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891efe7ed200/0x45228d86de4d580a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d5803 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.311066:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891efe7ed200/0x45228d86de4d580a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d5803 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.311075:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ed200, rc 0) 00000100:00100000:3.0:1787733939.311300:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705742976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1121us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733939.311308:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787733939.311786:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705742976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787733939.311816:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733939.311827:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733939.311899:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705743104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787733939.311936:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733939.311970:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787733939.312182:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705743104 00000100:00100000:1.0:1787733939.312189:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705743104 00000100:00100000:1.0:1787733939.312396:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787733939.312405:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705743104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.315117:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705743104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2706us (3173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733939.315131:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787733939.315560:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705743104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787733939.316315:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 261 00000100:00100000:0.0:1787733939.319058:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705743232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787733939.319149:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733939.319230:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787733939.320525:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705743232 00000100:00100000:1.0:1787733939.320538:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705743232 00000100:00100000:1.0:1787733939.320607:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787733939.320779:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705743232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.321046:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:5829:x1874574705743232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733939.324348:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:df19622b-ae94-4c8d-b052-574898624480:5829:1874574705743232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787733939.326771:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787733939.332343:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11673:1874574705743360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733939.332419:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733939.332466:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733939.332515:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705743360 00000100:00100000:3.0:1787733939.332529:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705743360 00000100:00100000:3.0:1787733939.332575:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787733939.332586:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:11673:x1874574705743360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733939.332831:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:11673:x1874574705743360:12345-0@lo:502:llog_process_th.0 Request processed in 244us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733939.332838:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787733939.333118:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11673:1874574705743360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787733939.333182:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787733939.333192:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787733939.333194:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787733939.333211:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff891ec7b73800 00000020:00000080:0.0:1787733939.333215:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787733939.333483:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11673:1874574705743488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787733939.333519:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733939.333543:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733939.335452:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705743488 00000100:00100000:3.0:1787733939.335463:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705743488 00000100:00100000:3.0:1787733939.335512:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787733939.335521:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:11673:x1874574705743488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787733939.335765:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:11673:x1874574705743488:12345-0@lo:502:llog_process_th.0 Request processed in 244us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733939.335772:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787733939.335950:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df19622b-ae94-4c8d-b052-574898624480:11673:1874574705743488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787733939.335987:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787733939.335995:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787733939.335998:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787733939.336002:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787733939.336515:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787733939.336535:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787733939.336544:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.336556:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733939.642486:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787733940.348457:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787733940.666621:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733941.691527:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733941.877294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733941.877356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733941.877393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733941.877417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733941.877452:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689982464 00000100:00100000:1.0:1787733941.877463:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689982464 00000100:00100000:1.0:1787733941.877525:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:1.0:1787733941.877537:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574689982464:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733941.877630:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574689982464:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 96us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733941.877638:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00080000:1.0:1787733941.877662:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787733941.877990:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689982336 00000100:00100000:3.0:1787733941.877996:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689982336 00000100:00100000:3.0:1787733941.878046:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689982592 00000100:00100000:3.0:1787733941.878049:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689982592 00000100:00100000:3.0:1787733941.878073:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:3.0:1787733941.878080:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574689982336:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733941.878130:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574689982336:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 51us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733941.878137:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:3.0:1787733941.878151:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:3.0:1787733941.878196:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689982592:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733941.878204:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689982208 00000100:00100000:0.0:1787733941.878208:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689982208 00000100:00100000:3.0:1787733941.878230:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574689982592:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 73us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733941.878237:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:0.0:1787733941.878238:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 267 00000100:00100000:0.0:1787733941.878244:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574689982208:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733941.878270:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574689982208:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733941.878276:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 267 00000100:00080000:1.0:1787733941.878729:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733942.076849:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705743744:0@lo:400:kworker.0 00000100:00100000:3.0:1787733942.076934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733942.076993:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705744256:0@lo:400:kworker.0 00000100:00100000:3.0:1787733942.077019:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733942.077048:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787733942.077054:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705743616:0@lo:400:kworker.0 00000100:00100000:3.0:1787733942.077082:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733942.077105:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705744128:0@lo:400:kworker.0 00000100:00100000:3.0:1787733942.077125:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733942.077201:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705743616 00000100:00100000:3.0:1787733942.077208:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705743616 00000100:00100000:3.0:1787733942.077249:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787733942.077258:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705743616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733942.077307:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705743616:12345-0@lo:400:kworker.0 Request processed in 49us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733942.077314:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787733942.077353:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705743872:0@lo:400:kworker.0 00000100:00100000:3.0:1787733942.077356:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705743744 00000100:00100000:3.0:1787733942.077359:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705743744 00000100:00100000:3.0:1787733942.077383:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705744128 00000100:00100000:1.0:1787733942.077383:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733942.077385:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705744128 00000100:00100000:3.0:1787733942.077406:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705743872 00000100:00100000:3.0:1787733942.077408:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705743872 00000100:00100000:1.0:1787733942.077409:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787733942.077415:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefdaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705744000:0@lo:400:kworker.0 00000100:00100000:3.0:1787733942.077421:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787733942.077427:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705743744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733942.077434:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733942.077459:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705743744:12345-0@lo:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733942.077461:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705744256 00000100:00100000:1.0:1787733942.077464:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705744256 00000100:00100000:3.0:1787733942.077465:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787733942.077477:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787733942.077482:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705744128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733942.077501:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705744000 00000100:00100000:1.0:1787733942.077505:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705744000 00000100:00100000:3.0:1787733942.077509:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705744128:12345-0@lo:400:kworker.0 Request processed in 27us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733942.077514:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787733942.077525:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787733942.077525:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787733942.077531:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705743872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733942.077531:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705744256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733942.077558:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705744256:12345-0@lo:400:kworker.0 Request processed in 27us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733942.077559:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705743872:12345-0@lo:400:kworker.0 Request processed in 29us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733942.077565:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787733942.077565:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787733942.077597:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787733942.077603:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705744000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733942.077633:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705744000:12345-0@lo:400:kworker.0 Request processed in 31us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733942.077639:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787733942.077675:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787733942.077679:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787733942.077681:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733942.077703:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705743616:0@lo:400:kworker.0 00000100:00100000:1.0:1787733942.077717:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705744128:0@lo:400:kworker.0 00000100:00100000:1.0:1787733942.077726:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705743744:0@lo:400:kworker.0 00010000:00080000:1.0:1787733942.077737:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6803480 x1874574705744256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733942.077746:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705744256:0@lo:400:kworker.0 00000100:00100000:1.0:1787733942.077788:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefdaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705744000:0@lo:400:kworker.0 00000100:00100000:1.0:1787733942.077795:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ed2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705743872:0@lo:400:kworker.0 00000100:00100000:1.0:1787733942.586524:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705744384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787733942.586598:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733942.586735:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705744384 00000100:00100000:3.0:1787733942.586743:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705744384 00000100:00100000:3.0:1787733942.586789:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787733942.586798:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefdaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705744384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787733942.586833:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733942.586877:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefdaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705744384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733942.586897:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787733942.587637:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c7ad80 x1874574705744384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733942.587655:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705744384:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787733942.714749:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733943.099614:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787733943.099639:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705744512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733943.099714:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733943.101697:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705744512 00000100:00100000:3.0:1787733943.101708:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705744512 00000100:00100000:3.0:1787733943.101764:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787733943.101774:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705744512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787733943.101811:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733943.101874:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705744512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733943.101879:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787733943.101924:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705744512:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1787733943.108400:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787733943.139766:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1787733943.742913:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733944.765813:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733945.790182:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733946.811687:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733946.996686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733946.996797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733946.996842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733946.996935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733946.996994:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689982848 00000100:00100000:1.0:1787733946.997004:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689982848 00000100:00100000:1.0:1787733946.997058:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689983104 00000100:00100000:1.0:1787733946.997062:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689983104 00000100:00100000:2.0:1787733946.997089:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689982976 00000100:00100000:1.0:1787733946.997102:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:2.0:1787733946.997103:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689982976 00000100:00100000:1.0:1787733946.997115:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689982848:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733946.997147:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:2.0:1787733946.997201:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689982976:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733946.997290:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:3.0:1787733946.997300:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574689983104:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733946.997389:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689982720 00000100:00100000:0.0:1787733946.997394:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689982720 00000100:00100000:2.0:1787733946.997412:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689982976:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 255us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733946.997421:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:0.0:1787733946.997431:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 269 00000100:00100000:0.0:1787733946.997441:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574689982720:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733946.997498:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574689982720:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 58us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733946.997505:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 269 00000100:00080000:0.0:1787733946.997594:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787733946.997598:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733946.998356:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574689982848:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 1227us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733946.998366:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:3.0:1787733947.000775:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574689983104:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 3468us (3831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733947.000787:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:0.0:1787733947.195563:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705745024:0@lo:400:kworker.0 00000100:00100000:0.0:1787733947.195654:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733947.195726:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787733947.195733:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874574705744896:0@lo:400:kworker.0 00000100:00100000:0.0:1787733947.195760:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733947.195793:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705745024 00000100:00100000:0.0:1787733947.195800:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705745024 00000100:00100000:0.0:1787733947.195852:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787733947.195861:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705745024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196026:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705744768:0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196054:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733947.196084:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705745280:0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196106:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733947.196125:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787733947.196130:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705744640:0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196179:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733947.196201:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705745152:0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196223:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733947.196249:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705744640 00000100:00100000:3.0:1787733947.196252:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705744640 00000100:00100000:3.0:1787733947.196279:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787733947.196286:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705744640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196339:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705744640:12345-0@lo:400:kworker.0 Request processed in 54us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733947.196346:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787733947.196377:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705745280 00000100:00100000:3.0:1787733947.196381:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705745280 00000100:00100000:3.0:1787733947.196405:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787733947.196411:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705745280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196443:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705745280:12345-0@lo:400:kworker.0 Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733947.196448:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787733947.196482:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705744640:0@lo:400:kworker.0 00010000:00080000:3.0:1787733947.196496:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ef6c7bb80 x1874574705745280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733947.196508:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705745280:0@lo:400:kworker.0 00000100:00080000:3.0:1787733947.196547:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787733947.196551:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787733947.196560:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705744896 00000100:00100000:3.0:1787733947.196564:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705744896 00000100:00100000:3.0:1787733947.196589:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705744768 00000100:00100000:3.0:1787733947.196599:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705744768 00000100:00100000:3.0:1787733947.196612:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705745152 00000100:00100000:3.0:1787733947.196614:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705745152 00000100:00100000:3.0:1787733947.196627:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787733947.196633:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874574705744896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196672:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874574705744896:12345-0@lo:400:kworker.0 Request processed in 39us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733947.196678:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787733947.196688:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787733947.196693:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705744768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196721:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705744768:12345-0@lo:400:kworker.0 Request processed in 28us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733947.196727:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787733947.196736:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787733947.196742:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705745152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196766:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705745152:12345-0@lo:400:kworker.0 Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733947.196771:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1787733947.196784:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733947.196801:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874574705744896:0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196822:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705745152:0@lo:400:kworker.0 00000100:00100000:3.0:1787733947.196830:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705744768:0@lo:400:kworker.0 00000100:00100000:0.0:1787733947.197103:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705745024:12345-0@lo:400:kworker.0 Request processed in 1243us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733947.197111:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787733947.197136:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787733947.197141:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891ed2006a00, transno 4294967300 00000100:00100000:0.0:1787733947.197152:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705745024:0@lo:400:kworker.0 00000100:00100000:0.0:1787733947.720223:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787733947.720245:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705745408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787733947.720311:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733947.720378:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705745408 00000100:00100000:0.0:1787733947.720385:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705745408 00000100:00100000:0.0:1787733947.720429:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787733947.720438:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705745408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787733947.720471:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787733947.720511:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705745408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733947.720532:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787733947.720573:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe90ce00 x1874574705745408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733947.720591:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705745408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787733947.834393:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733948.218678:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787733948.218710:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705745536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733948.218781:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733948.218870:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705745536 00000100:00100000:0.0:1787733948.218878:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705745536 00000100:00100000:0.0:1787733948.218925:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787733948.218934:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705745536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787733948.218969:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787733948.219014:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705745536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733948.219022:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787733948.219080:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705745536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787733948.859780:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733949.883557:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787733950.590201:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787733950.906418:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733951.933327:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733952.125185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733952.125224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733952.125277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733952.125317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733952.125366:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689983360 00000100:00100000:0.0:1787733952.125395:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689983360 00000100:00080000:2.0:1787733952.125449:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733952.125479:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689983616 00000100:00100000:2.0:1787733952.125483:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689983616 00000100:00100000:0.0:1787733952.125491:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:0.0:1787733952.125509:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2357:x1874574689983360:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733952.125519:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:2.0:1787733952.125526:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2357:x1874574689983616:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733952.125607:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2357:x1874574689983360:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 105us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733952.125615:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:2.0:1787733952.125629:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2357:x1874574689983616:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 102us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733952.125643:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00080000:2.0:1787733952.125667:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733952.125690:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689983232 00000100:00100000:1.0:1787733952.125697:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689983232 00000100:00100000:1.0:1787733952.125733:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 271 00000100:00100000:1.0:1787733952.125742:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2357:x1874574689983232:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733952.125772:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2357:x1874574689983232:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733952.125780:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 271 00000100:00100000:3.0:1787733952.128212:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689983488 00000100:00100000:3.0:1787733952.128238:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689983488 00000100:00100000:3.0:1787733952.128389:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1787733952.128399:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2357:x1874574689983488:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733952.128475:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2357:x1874574689983488:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 78us (3156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733952.128482:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00080000:2.0:1787733952.128532:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787733952.314897:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705745792:0@lo:400:kworker.0 00000100:00100000:0.0:1787733952.314898:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705745664:0@lo:400:kworker.0 00000100:00100000:2.0:1787733952.315063:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705745920:0@lo:400:kworker.0 00000100:00100000:3.0:1787733952.315530:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705746048:0@lo:400:kworker.0 00000100:00100000:0.0:1787733952.320638:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733952.320698:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705746176:0@lo:400:kworker.0 00000100:00100000:0.0:1787733952.320746:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733952.320802:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705745664 00000100:00100000:0.0:1787733952.320809:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705745664 00000100:00100000:0.0:1787733952.320866:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787733952.320875:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705745664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733952.320922:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705745664:12345-0@lo:400:kworker.0 Request processed in 48us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733952.320929:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787733952.320968:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705746176 00000100:00100000:0.0:1787733952.320972:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705746176 00000100:00100000:0.0:1787733952.321239:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787733952.321246:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705746176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733952.321278:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705746176:12345-0@lo:400:kworker.0 Request processed in 33us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733952.321284:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787733952.321318:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705745664:0@lo:400:kworker.0 00000100:00100000:0.0:1787733952.321330:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705746176:0@lo:400:kworker.0 00000100:00080000:0.0:1787733952.321388:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733952.323512:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733952.323584:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705745792 00000100:00100000:0.0:1787733952.323596:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705745792 00000100:00100000:1.0:1787733952.323600:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705746304:0@lo:400:kworker.0 00000100:00100000:0.0:1787733952.323652:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787733952.323663:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705745792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733952.323674:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733952.323725:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705746304 00000100:00100000:1.0:1787733952.323733:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705746304 00000100:00100000:0.0:1787733952.323773:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705745792:12345-0@lo:400:kworker.0 Request processed in 111us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733952.323795:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787733952.323802:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787733952.323815:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705746304:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787733952.323841:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787733952.323905:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705745792:0@lo:400:kworker.0 00010000:00080000:0.0:1787733952.323922:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efed49880 x1874574705746304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733952.323933:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705746304:0@lo:400:kworker.0 00000100:00100000:1.0:1787733952.325702:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705746304:12345-0@lo:400:kworker.0 Request processed in 1883us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733952.325716:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787733952.326112:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733952.326248:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705745920 00000100:00100000:0.0:1787733952.326255:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705745920 00000100:00100000:0.0:1787733952.326324:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787733952.326333:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705745920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733952.326384:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705745920:12345-0@lo:400:kworker.0 Request processed in 53us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733952.326391:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787733952.326475:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733952.326547:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705746048 00000100:00100000:0.0:1787733952.326551:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705746048 00000100:00100000:0.0:1787733952.326582:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787733952.326589:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705746048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733952.326621:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705746048:12345-0@lo:400:kworker.0 Request processed in 32us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733952.326627:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787733952.326699:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705746048:0@lo:400:kworker.0 00000100:00100000:2.0:1787733952.326934:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705745920:0@lo:400:kworker.0 00000100:00080000:1.0:1787733952.327122:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787733952.327127:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733952.828218:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705746432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787733952.828298:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733952.828340:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705746432 00000100:00100000:2.0:1787733952.828347:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705746432 00000100:00100000:2.0:1787733952.828392:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787733952.828400:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705746432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787733952.828434:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733952.828468:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705746432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733952.828475:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787733952.828539:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe90e300 x1874574705746432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733952.828556:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705746432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787733952.954375:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733953.348893:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705746560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733953.349206:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733953.350696:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705746560 00000100:00100000:3.0:1787733953.350707:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705746560 00000100:00100000:3.0:1787733953.350766:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787733953.350782:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705746560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787733953.350815:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733953.350874:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705746560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733953.350881:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787733953.353127:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705746560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787733953.978362:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733955.003666:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733956.026540:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733957.051092:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733957.246806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733957.246869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733957.246947:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689983872 00000100:00100000:0.0:1787733957.246959:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689983872 00000100:00100000:0.0:1787733957.247040:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 105 00000100:00100000:0.0:1787733957.247078:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574689983872:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733957.247194:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574689983872:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 120us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733957.247202:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 105 00000100:00100000:3.0:1787733957.247204:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689983744 00000100:00100000:3.0:1787733957.247210:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689983744 00000100:00100000:3.0:1787733957.247248:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 273 00000100:00100000:3.0:1787733957.247257:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2356:x1874574689983744:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733957.247289:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2356:x1874574689983744:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 35us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733957.247304:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 273 00000100:00080000:2.0:1787733957.247814:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733957.259040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733957.259106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733957.259299:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689984128 00000100:00100000:2.0:1787733957.259310:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689984128 00000100:00100000:2.0:1787733957.259402:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:2.0:1787733957.259413:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2356:x1874574689984128:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733957.259487:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2356:x1874574689984128:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 76us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733957.259494:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00080000:1.0:1787733957.260131:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787733957.260344:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689984000 00000100:00100000:0.0:1787733957.260350:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689984000 00000100:00100000:0.0:1787733957.260403:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787733957.260414:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2353:x1874574689984000:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:0.0:1787733957.260436:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5746 00000100:00080000:0.0:1787733957.260446:0:6679:0:(import.c:65:import_set_state_nolock()) ffff891efe87a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787733957.260490:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:1.0:1787733957.260580:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787733957.261354:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733957.261396:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+2:2353:x1874574689984000:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 983us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733957.261404:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1787733957.435381:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705746688:0@lo:400:kworker.0 00000100:00100000:3.0:1787733957.435475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733957.435540:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705747200:0@lo:400:kworker.0 00000100:00100000:3.0:1787733957.435568:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733957.435596:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787733957.435603:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705746816:0@lo:400:kworker.0 00000100:00100000:3.0:1787733957.435625:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733957.435643:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705747328:0@lo:400:kworker.0 00000100:00100000:3.0:1787733957.435666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733957.435692:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705746944:0@lo:400:kworker.0 00000100:00100000:3.0:1787733957.435714:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733957.435733:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787733957.435739:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705747072:0@lo:400:kworker.0 00000100:00100000:3.0:1787733957.435759:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733957.435791:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705747200 00000100:00100000:3.0:1787733957.435798:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705747200 00000100:00100000:3.0:1787733957.435851:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705746816 00000100:00100000:3.0:1787733957.435854:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705746816 00000100:00100000:3.0:1787733957.435868:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705746944 00000100:00100000:3.0:1787733957.435870:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705746944 00000100:00100000:3.0:1787733957.435901:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787733957.435911:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705747200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733957.436179:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705746688 00000100:00100000:2.0:1787733957.436197:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705746688 00000100:00100000:2.0:1787733957.436228:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787733957.436235:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705746688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733957.436268:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705746688:12345-0@lo:400:kworker.0 Request processed in 34us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733957.436275:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787733957.436336:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705747328 00000100:00100000:2.0:1787733957.436340:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705747328 00000100:00100000:2.0:1787733957.436363:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705747072 00000100:00100000:2.0:1787733957.436367:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705747072 00000100:00100000:2.0:1787733957.436386:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787733957.436392:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705747328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733957.436533:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705747328:12345-0@lo:400:kworker.0 Request processed in 140us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733957.436539:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787733957.436552:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787733957.436559:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705747072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733957.436590:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705747072:12345-0@lo:400:kworker.0 Request processed in 32us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733957.436596:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787733957.436617:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787733957.436624:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705746816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733957.436652:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705746816:12345-0@lo:400:kworker.0 Request processed in 29us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733957.436658:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787733957.436670:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787733957.436676:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705746944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733957.436709:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705746944:12345-0@lo:400:kworker.0 Request processed in 33us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733957.436715:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787733957.436773:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705746816:0@lo:400:kworker.0 00010000:00080000:2.0:1787733957.436788:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efed5e300 x1874574705747328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733957.436798:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705747328:0@lo:400:kworker.0 00000100:00100000:2.0:1787733957.436807:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705746688:0@lo:400:kworker.0 00000100:00100000:2.0:1787733957.436816:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705747200:0@lo:400:kworker.0 00000100:00100000:2.0:1787733957.436878:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705747072:0@lo:400:kworker.0 00000100:00100000:2.0:1787733957.436900:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705746944:0@lo:400:kworker.0 00000100:00100000:3.0:1787733957.437055:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705747200:12345-0@lo:400:kworker.0 Request processed in 54us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733957.437062:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1787733957.438707:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787733957.438716:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787733957.438719:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733957.950220:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705747456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787733957.950290:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733957.950367:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705747456 00000100:00100000:2.0:1787733957.950387:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705747456 00000100:00100000:2.0:1787733957.950443:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787733957.950452:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705747456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787733957.950488:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733957.950528:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705747456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733957.950535:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787733957.950579:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efed5dc00 x1874574705747456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787733957.950611:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705747456:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787733958.075897:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733958.471487:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705747584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787733958.471557:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733958.471618:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705747584 00000100:00100000:2.0:1787733958.471776:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705747584 00000100:00100000:2.0:1787733958.471821:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787733958.471830:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705747584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787733958.471862:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733958.471915:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705747584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733958.471922:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787733958.471964:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705747584:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787733958.532201:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000020:00000080:3.0:1787733958.532212:0:6705:0:(genops.c:885:class_export_put()) final put ffff891efe87f800/a2c26bfa-a021-441a-9db5-0c3742b5640d 00000020:00000080:3.0:1787733958.532247:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891efe87f800/a2c26bfa-a021-441a-9db5-0c3742b5640d for lustre-OST0000 00000020:00000080:3.0:1787733958.532299:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891efe87a000 for lustre-OST0000 00010000:00010000:1.0:1787733959.101067:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733960.122320:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787733960.840282:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787733961.150039:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787733961.226089:0:11833:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:46:00 (1787733960) 00010000:00010000:1.0:1787733962.172107:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733962.358394:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733962.358455:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733962.358488:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733962.358633:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689984384 00000100:00100000:0.0:1787733962.358644:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689984384 00000100:00100000:0.0:1787733962.358710:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689984512 00000100:00100000:0.0:1787733962.358714:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689984512 00000100:00100000:0.0:1787733962.358738:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:0.0:1787733962.358748:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574689984384:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733962.358838:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574689984384:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 91us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733962.358846:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:0.0:1787733962.358864:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:0.0:1787733962.358896:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574689984512:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733962.358921:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574689984512:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733962.358928:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:3.0:1787733962.359701:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689984256 00000100:00100000:3.0:1787733962.359709:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689984256 00000100:00080000:1.0:1787733962.359819:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733962.360317:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 275 00000100:00100000:3.0:1787733962.360339:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574689984256:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733962.360417:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574689984256:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 81us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733962.360424:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 275 00000100:00100000:0.0:1787733962.555059:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705747968:0@lo:400:kworker.0 00000100:00100000:0.0:1787733962.555137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733962.555182:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705747968 00000100:00100000:3.0:1787733962.555191:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705747968 00000100:00100000:3.0:1787733962.555260:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787733962.555272:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705747968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733962.555278:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705748096:0@lo:400:kworker.0 00000100:00100000:3.0:1787733962.555331:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705747968:12345-0@lo:400:kworker.0 Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733962.555338:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787733962.555545:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733962.555608:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705747968:0@lo:400:kworker.0 00000100:00100000:3.0:1787733962.555680:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705748096 00000100:00100000:3.0:1787733962.555685:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705748096 00000100:00100000:3.0:1787733962.555722:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787733962.555730:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705748096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733962.555767:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705748096:12345-0@lo:400:kworker.0 Request processed in 38us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733962.555774:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787733962.555835:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705748096:0@lo:400:kworker.0 00000100:00100000:2.0:1787733962.555934:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705747712:0@lo:400:kworker.0 00000100:00100000:2.0:1787733962.555970:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733962.556010:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705748224:0@lo:400:kworker.0 00000100:00100000:3.0:1787733962.556021:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705747712 00000100:00100000:3.0:1787733962.556028:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705747712 00000100:00100000:2.0:1787733962.556037:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733962.556062:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787733962.556070:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705747840:0@lo:400:kworker.0 00000100:00100000:3.0:1787733962.556101:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787733962.556102:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733962.556114:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705747712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733962.556124:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705748352:0@lo:400:kworker.0 00000100:00100000:1.0:1787733962.556265:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705748224 00000100:00100000:1.0:1787733962.556269:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705748224 00000100:00100000:2.0:1787733962.556589:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733962.556628:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705747712:0@lo:400:kworker.0 00000100:00100000:2.0:1787733962.556650:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705748352 00000100:00100000:2.0:1787733962.556654:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705748352 00000100:00100000:2.0:1787733962.556715:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787733962.556723:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705748352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733962.556762:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705748352:12345-0@lo:400:kworker.0 Request processed in 40us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733962.556768:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787733962.557087:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705747840 00000100:00100000:0.0:1787733962.557092:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705747840 00000100:00100000:0.0:1787733962.557120:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787733962.557128:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705748224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733962.557183:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705748224:12345-0@lo:400:kworker.0 Request processed in 56us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733962.557190:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787733962.557203:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787733962.557210:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705747840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733962.557236:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705747840:12345-0@lo:400:kworker.0 Request processed in 26us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733962.557242:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1787733962.557274:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787733962.557278:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787733962.557287:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787733962.558941:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705747840:0@lo:400:kworker.0 00010000:00080000:0.0:1787733962.558959:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe90e680 x1874574705748352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787733978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787733962.558971:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705748352:0@lo:400:kworker.0 00000100:00100000:0.0:1787733962.558984:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705748224:0@lo:400:kworker.0 00000100:00100000:3.0:1787733962.560240:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705747712:12345-0@lo:400:kworker.0 Request processed in 4123us (4262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733962.560255:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787733962.607857:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733962.608230:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689984640 00000100:00100000:0.0:1787733962.608241:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689984640 00000100:00100000:0.0:1787733962.608309:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787733962.608327:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:10213:x1874574689984640:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787733962.608348:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733962.608532:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19412 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733962.608610:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5818 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733962.608624:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733962.608636:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733962.613730:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787733962.613742:0:8190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733962.615477:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733962.615530:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19412 expref: 7 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733962.615560:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19412 expref: 6 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733962.615568:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771b00) 00010000:00010000:0.0:1787733962.615571:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787733962.615575:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659e00, rc 0) 00000100:00100000:0.0:1787733962.615660:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:10213:x1874574689984640:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 7336us (7812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733962.615668:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787733962.621291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733962.621478:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689984768 00000100:00100000:2.0:1787733962.621490:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689984768 00000100:00100000:2.0:1787733962.621556:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:2.0:1787733962.621567:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:10214:x1874574689984768:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787733962.621588:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733962.621610:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d581f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19419 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.621678:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5826 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.621693:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5826 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.621705:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5826 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.621721:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d582d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.621727:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d582d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.621750:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d582d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.622645:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5834 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.622660:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5834 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.622669:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5834 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733962.622750:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787733962.622756:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733962.622977:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5834 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.622990:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5826 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.622997:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5826 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.624979:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5826 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.624989:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733962.624994:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5826 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625118:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5826 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625170:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771b00) 00010000:00010000:2.0:1787733962.625174:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733962.625179:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5826 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625186:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5826 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625207:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d582d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625214:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d582d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625219:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d582d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625224:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733962.625227:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d582d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625233:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d582d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625240:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff891ed3d91a00) 00010000:00010000:2.0:1787733962.625242:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733962.625245:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d582d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625251:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d582d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625944:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d581f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19419 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625969:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5834 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19419 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733962.625977:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff891ed3d91500) 00010000:00010000:2.0:1787733962.625980:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787733962.625982:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13caa00, rc 0) 00000100:00100000:2.0:1787733962.626653:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:10214:x1874574689984768:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 5083us (5367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733962.626665:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:2.0:1787733962.633505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733962.633657:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689985024 00000100:00100000:3.0:1787733962.633668:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689985024 00000100:00100000:3.0:1787733962.633739:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1787733962.633750:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:10214:x1874574689985024:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733962.633772:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733962.633808:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d583b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19420 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.633895:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5842 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.633912:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5842 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.633924:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5842 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.633975:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5849 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.633984:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5849 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.633991:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5849 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.634652:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ece00/0x45228d86de4d5850 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.634663:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ece00/0x45228d86de4d5850 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.634671:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ece00/0x45228d86de4d5850 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733962.634681:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787733962.634933:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5842 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.634941:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5842 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.634949:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5842 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.634956:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7eda00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733962.634961:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5842 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.634969:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5842 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.634983:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff891ed3d91500) 00010000:00010000:3.0:1787733962.634986:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733962.634990:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5842 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.635007:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5842 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.635022:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5849 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.635028:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5849 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.635034:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5849 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.635039:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733962.635042:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5849 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.635048:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5849 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.635056:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff891ec6634000) 00010000:00010000:3.0:1787733962.635059:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733962.635061:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5849 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.635068:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5849 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.637136:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d583b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19420 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.637274:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ece00/0x45228d86de4d5850 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19420 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733962.637293:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:3.0:1787733962.637297:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733962.637301:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ece00, rc 0) 00000100:00100000:3.0:1787733962.637375:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:10214:x1874574689985024:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 3626us (3879us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787733962.637385:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1787733962.642060:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733962.643100:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689985152 00000100:00100000:2.0:1787733962.643113:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689985152 00000100:00100000:2.0:1787733962.643208:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:2.0:1787733962.643219:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:10214:x1874574689985152:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787733962.643338:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:10214:x1874574689985152:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 119us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733962.643347:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000040:00080000:1.0:1787733962.875829:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787733963.084195:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787733963.084220:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe59dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705748480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787733963.084304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733963.084382:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705748480 00000100:00100000:1.0:1787733963.084390:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705748480 00000100:00100000:1.0:1787733963.084439:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787733963.084462:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705748480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787733963.084504:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733963.084553:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705748480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733963.084560:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787733963.084702:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efe59dc00 x1874574705748480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787733979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733963.084721:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe59dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705748480:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787733963.194395:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733963.583410:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705748608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787733963.583484:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733963.583681:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705748608 00000100:00100000:2.0:1787733963.583689:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705748608 00000100:00100000:2.0:1787733963.583737:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787733963.583747:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705748608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787733963.583799:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733963.584021:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705748608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 274us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733963.584028:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787733963.584329:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705748608:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787733963.606315:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:3.0:1787733964.224387:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733964.319243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733964.319471:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689985280 00000100:00100000:1.0:1787733964.319486:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689985280 00000100:00100000:1.0:1787733964.319575:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:1.0:1787733964.319590:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:10256:x1874574689985280:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787733964.319618:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733964.319643:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d585e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19427 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.319728:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5865 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.319746:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5865 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.319759:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5865 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.319801:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d586c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.319808:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d586c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.319815:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d586c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320124:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5865 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320131:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5865 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320136:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5865 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320141:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733964.320145:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5865 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320152:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5865 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320188:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771b00) 00010000:00010000:1.0:1787733964.320191:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733964.320196:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320202:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320230:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d586c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320237:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d586c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320243:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d586c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320248:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733964.320251:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d586c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320258:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d586c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320266:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff891ec28ef600) 00010000:00010000:1.0:1787733964.320268:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733964.320272:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d586c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320278:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d586c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320321:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d585e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19427 expref: 9 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320332:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771b00) 00010000:00010000:1.0:1787733964.320335:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733964.320345:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d585e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19427 expref: 9 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.320358:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc400, rc 0) 00000100:00100000:1.0:1787733964.320433:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:10256:x1874574689985280:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 848us (1208us total) trans 0 rc 301/301 00000100:00100000:1.0:1787733964.320439:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00080000:3.0:1787733964.320637:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733964.345442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733964.345685:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689985536 00000100:00100000:3.0:1787733964.345700:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689985536 00000100:00100000:3.0:1787733964.345789:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:3.0:1787733964.345804:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:10256:x1874574689985536:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:3.0:1787733964.345890:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733964.345931:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5818 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19412 expref: 8 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.345953:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771b00) 00010000:00010000:3.0:1787733964.347316:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733964.348359:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5873 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.348385:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5873 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.348399:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5873 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.348425:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.348433:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.348439:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733964.358528:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787733964.358560:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5873 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.358575:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5873 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.358950:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5873 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.358957:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ede00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733964.359023:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5873 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.359031:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5873 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.359050:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6634000) 00010000:00010000:3.0:1787733964.359053:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733964.359057:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5873 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.359071:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5873 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787733964.359097:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c92057d reply state 000000006da67137 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733964.359104:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787733964.360429:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:10256:x1874574689985536:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 14615us (14989us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787733964.360442:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00010000:00010000:2.0:1787733964.363212:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.363244:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.363254:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.363262:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7eda00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733964.363268:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.363277:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.363308:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff891ec6634b00) 00010000:00010000:2.0:1787733964.363312:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733964.363317:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.363324:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d587a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733964.423194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733964.423503:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689985664 00000100:00100000:0.0:1787733964.423516:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689985664 00000100:00100000:0.0:1787733964.423895:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1787733964.423909:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:10264:x1874574689985664:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:0.0:1787733964.423943:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733964.423989:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5881 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1942e expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.424080:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5888 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.424095:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.424105:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733964.424621:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787733964.424626:0:8190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733964.424670:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.424697:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5881 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1942e expref: 10 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.424716:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1942e expref: 9 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.424723:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:2.0:1787733964.424726:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787733964.424729:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658800, rc 0) 00000100:00100000:2.0:1787733964.424823:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:10264:x1874574689985664:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 918us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733964.424829:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:1.0:1787733964.464425:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.464562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689985792 00000100:00100000:2.0:1787733964.464575:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689985792 00000100:00100000:2.0:1787733964.464665:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1787733964.464679:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:10270:x1874574689985792:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733964.464709:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733964.464737:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d588f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19435 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.464838:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5896 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.464876:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465082:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465102:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d589d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465110:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d589d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465118:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d589d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465316:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031c00/0x45228d86de4d58a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465325:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031c00/0x45228d86de4d58a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465333:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031c00/0x45228d86de4d58a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733964.465371:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787733964.465374:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733964.465422:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031c00/0x45228d86de4d58a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465437:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465455:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5896 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465463:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5896 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465469:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733964.465475:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5896 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465484:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5896 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465497:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:2.0:1787733964.465500:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733964.465506:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5896 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465512:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5896 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465529:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d589d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465535:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d589d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465541:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d589d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465546:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733964.465553:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d589d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465560:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d589d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465567:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff891ee0dfc800) 00010000:00010000:2.0:1787733964.465569:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733964.465571:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d589d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465577:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d589d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465615:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d588f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19435 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465630:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031c00/0x45228d86de4d58a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19435 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.465638:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733964.465641:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787733964.465643:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031c00, rc 0) 00000100:00100000:2.0:1787733964.465728:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:10270:x1874574689985792:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1051us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733964.465735:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:1.0:1787733964.469945:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733964.470065:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689986048 00000100:00100000:3.0:1787733964.470079:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689986048 00000100:00100000:3.0:1787733964.470187:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:3.0:1787733964.470208:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:10270:x1874574689986048:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787733964.470240:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733964.470269:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d58ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1943c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.470518:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d58b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.470539:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d58b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.470553:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d58b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.476234:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.476257:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.476287:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787733964.484539:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787733964.484761:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484793:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484813:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484856:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d58b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484864:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d58b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484871:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d58b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484877:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733964.484882:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d58b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484890:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d58b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484902:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:3.0:1787733964.484905:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733964.484920:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d58b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484926:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d58b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787733964.484939:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eef180c7 reply state 000000002a23309b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733964.484946:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787733964.484977:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d58ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1943c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484987:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1943c expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.484992:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634d00) 00010000:00010000:3.0:1787733964.484994:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787733964.484995:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ed600, rc 0) 00000100:00100000:3.0:1787733964.485060:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:10270:x1874574689986048:12345-192.168.201.34@tcp:101:bash.0 Request processed in 14857us (15132us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787733964.485067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00010000:00010000:2.0:1787733964.489591:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.489616:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.489644:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.489652:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7eda00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733964.489658:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.489668:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.489690:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec6634000) 00010000:00010000:2.0:1787733964.489694:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733964.489699:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.489706:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d58b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733964.496200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733964.497613:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689986176 00000100:00100000:3.0:1787733964.497631:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689986176 00000100:00100000:3.0:1787733964.497706:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:3.0:1787733964.497717:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1874574689986176:12345-192.168.201.34@tcp:8:bash.0 00010000:00080000:3.0:1787733964.497760:0:6729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:3.0:1787733964.497815:0:6729:0:(genops.c:1385:class_connect()) connect: client a2c26bfa-a021-441a-9db5-0c3742b5640d, cookie 0x45228d86de4d58ce 00002000:00100000:3.0:1787733964.497830:0:6729:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a2c26bfa-a021-441a-9db5-0c3742b5640d/ffff891ec7d3f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787733964.497862:0:6729:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787733964.498482:0:6729:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787733964.498524:0:6729:0:(import.c:65:import_set_state_nolock()) ffff891f0184d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787733964.498624:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2353:x1874574689986176:12345-192.168.201.34@tcp:8:bash.0 Request processed in 906us (2470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733964.498634:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:1.0:1787733964.504805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.505740:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689986304 00000100:00100000:2.0:1787733964.505754:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689986304 00000100:00100000:2.0:1787733964.505880:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1787733964.506025:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:0:x1874574689986304:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733964.506052:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733964.506086:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b39bcc8/0x45228d86de4d58d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19443 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787733964.506122:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787733964.506146:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=282s v=(0 0) 00010000:00010000:2.0:1787733964.506230:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733964.506243:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b39bcc8/0x45228d86de4d58d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19443 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.506274:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b39bcc8/0x45228d86de4d58d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19443 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.506293:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030800, rc 0) 00000100:00100000:2.0:1787733964.506367:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:0:x1874574689986304:12345-192.168.201.34@tcp:101:bash.0 Request processed in 347us (1580us total) trans 0 rc 0/0 00000100:00080000:3.0:1787733964.508344:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787733964.512190:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:1.0:1787733964.513476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733964.513539:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689986432 00000100:00100000:0.0:1787733964.513554:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689986432 00000100:00100000:0.0:1787733964.513638:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1787733964.513651:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:10270:x1874574689986432:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787733964.513675:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733964.513703:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1944a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.513744:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b39bcc8/0x45228d86de4d58d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19443 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.513754:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787733964.513759:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787733964.513782:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.513830:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b39bcc8/0x45228d86de4d58d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19443 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.513845:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b39bcc8/0x45228d86de4d58d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19443 expref: 8 pid: 6681 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733964.513892:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874574705748736:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733964.514021:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef83f1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787733964.517880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.517971:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689986560 00000100:00100000:2.0:1787733964.517983:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689986560 00010000:00010000:2.0:1787733964.518045:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b39bcc8/0x45228d86de4d58d5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19443 expref: 9 pid: 6681 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733964.518069:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874574705748736:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733964.518099:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:2.0:1787733964.518109:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2355:x1874574689986560:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733964.518111:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.518128:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733964.518131:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659200, rc 0) 00010000:00010000:2.0:1787733964.518181:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b39bcc8/0x45228d86de4d58d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19443 expref: 9 pid: 6681 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.518196:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b39bcc8/0x45228d86de4d58d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19443 expref: 9 pid: 6681 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.518224:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b39bcc8/0x45228d86de4d58d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19443 expref: 9 pid: 6681 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733964.518239:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:10270:x1874574689986432:12345-192.168.201.34@tcp:101:bash.0 Request processed in 4591us (4768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733964.518247:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00010000:00010000:2.0:1787733964.518260:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733964.518265:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733964.518275:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.518286:0:11156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.518349:0:11156:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733964.518366:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11156:1874574705748864:192.168.201.34@tcp:105: 00000100:00100000:2.0:1787733964.518428:0:11156:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082600 going to sleep for 11 seconds 00000100:00100000:2.0:1787733964.522257:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11156:1874574705748864:192.168.201.34@tcp:105: 00010000:00010000:2.0:1787733964.522305:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733964.522403:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574689986560:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 4293us (4536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733964.522416:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:1.0:1787733964.522938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733964.523000:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689986816 00000100:00100000:3.0:1787733964.523010:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689986816 00000100:00100000:3.0:1787733964.523070:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1787733964.523081:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:10270:x1874574689986816:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1787733964.523657:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:10270:x1874574689986816:12345-192.168.201.34@tcp:35:bash.0 Request processed in 576us (719us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787733964.523671:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:0.0:1787733964.609394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.609727:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689987072 00000100:00100000:2.0:1787733964.609741:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689987072 00000100:00100000:2.0:1787733964.609837:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1787733964.609869:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:10280:x1874574689987072:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733964.609906:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733964.609936:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d58e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19451 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733964.610242:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787733964.610407:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d58e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19451 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.610425:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:2.0:1787733964.610428:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787733964.610435:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d58e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19451 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.610455:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030800, rc 0) 00000100:00100000:2.0:1787733964.610545:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:10280:x1874574689987072:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 678us (1270us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787733964.610553:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:1.0:1787733964.614434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733964.615035:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689987328 00000100:00100000:0.0:1787733964.615049:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689987328 00000100:00100000:0.0:1787733964.615131:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1787733964.615145:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:10280:x1874574689987328:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787733964.615556:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:10280:x1874574689987328:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 412us (1136us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787733964.615565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1787733964.701442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.701549:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689987456 00000100:00100000:2.0:1787733964.701563:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689987456 00000100:00100000:2.0:1787733964.701652:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:2.0:1787733964.701665:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:10286:x1874574689987456:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733964.701698:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733964.701728:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d58f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19458 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.701834:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d58f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.701871:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d58f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.701897:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d58f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733964.701983:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787733964.701988:0:8190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733964.702018:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d58f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.702053:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d58f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19458 expref: 17 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.702078:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d58f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19458 expref: 16 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.702089:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733964.702092:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787733964.702097:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031000, rc 0) 00000100:00100000:2.0:1787733964.702263:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:10286:x1874574689987456:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 600us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733964.702272:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1787733964.709499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733964.709654:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689987712 00000100:00100000:0.0:1787733964.709666:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689987712 00000100:00100000:0.0:1787733964.709863:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:0.0:1787733964.709876:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:10286:x1874574689987712:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733964.709908:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733964.709951:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d58ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1945f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.710089:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.710108:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.710126:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733964.710142:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787733964.710592:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d58ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1945f expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.710612:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1945f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.710619:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634d00) 00010000:00010000:0.0:1787733964.710621:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733964.710624:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658000, rc 0) 00000100:00100000:0.0:1787733964.710697:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:10286:x1874574689987712:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 824us (1216us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787733964.710705:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:1.0:1787733964.714776:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733964.715241:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689988096 00000100:00100000:0.0:1787733964.715317:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689988096 00000100:00100000:0.0:1787733964.715446:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:0.0:1787733964.715460:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:2356:x1874574689988096:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733964.715498:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733964.715524:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5906 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1945f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.715544:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634d00) 00010000:00010000:0.0:1787733964.715548:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733964.715614:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+17:2356:x1874574689988096:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 158us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733964.715623:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1787733964.715794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.715878:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689987968 00000100:00100000:2.0:1787733964.715957:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689987968 00000100:00100000:2.0:1787733964.716043:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1787733964.716053:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+17:10286:x1874574689987968:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733964.716080:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733964.716105:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5914 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19466 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.716258:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d591b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.716275:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d591b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.716422:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d591b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733964.716438:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787733964.716598:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5914 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19466 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.716619:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d591b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19466 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.716630:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634d00) 00010000:00010000:2.0:1787733964.716633:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787733964.716636:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030a00, rc 0) 00000100:00100000:2.0:1787733964.716686:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:10286:x1874574689987968:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 635us (892us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787733964.716694:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:1.0:1787733964.724663:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.724768:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689988224 00000100:00100000:2.0:1787733964.724783:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689988224 00000100:00100000:2.0:1787733964.724855:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1787733964.724866:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574689988224:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:2.0:1787733964.724953:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.724978:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.724988:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733964.724993:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733964.724998:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.725055:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.725074:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 7 pid: 6679 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733964.725091:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874574705748992:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733964.725255:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082540 going to sleep for 11 seconds 00000100:00100000:2.0:1787733964.729975:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874574705748992:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733964.730024:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733964.733324:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.734823:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689988352 00000100:00100000:2.0:1787733964.734843:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689988352 00002000:00100000:2.0:1787733964.734927:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff891efea9c000 x1874574689988352/t0(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:430/0 lens 504/0 e 0 to 0 dl 1787733975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787733964.734958:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891efea9c000 with x1874574689988352 ext(0->12) 00010000:00010000:2.0:1787733964.734972:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 8 pid: 6679 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.734992:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 8 pid: 6679 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787733964.735001:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff891efea9c000 00000100:00100000:2.0:1787733964.735050:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1787733964.735062:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2354:x1874574689988352:12345-192.168.201.34@tcp:4:lfs.0 00000001:00100000:0.0:1787733964.763417:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000100:00100000:2.0:1787733964.764054:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2354:x1874574689988352:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 28987us (30735us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787733964.764068:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00002000:00100000:2.0:1787733964.764082:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff891efea9c000 x1874574689988352/t4294967299(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:430/0 lens 504/448 e 0 to 0 dl 1787733975 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787733964.764092:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891efea9c000 with x1874574689988352 ext(0->12) 00010000:00010000:2.0:1787733964.764103:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 9 pid: 6679 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.764123:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 9 pid: 6679 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787733964.764131:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff891efea9c000 00000100:00100000:3.0:1787733964.774301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.774525:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689988480 00000100:00100000:2.0:1787733964.774550:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689988480 00010000:00010000:2.0:1787733964.774605:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 9 pid: 6679 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733964.774649:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:2.0:1787733964.774661:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2356:x1874574689988480:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733964.774677:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787733964.774698:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787733964.774702:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787733965 00002000:00010000:2.0:1787733964.774704:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787733965 00002000:00010000:2.0:1787733964.774707:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787733965 00010000:00010000:2.0:1787733964.774713:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 9 pid: 6679 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.774729:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 9 pid: 6679 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.774753:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f20de79/0x45228d86de4d58dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1944a expref: 9 pid: 6679 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.774794:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733964.774799:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733964.774806:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.774817:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.774866:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733964.774929:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2356:x1874574689988480:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 269us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733964.774938:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00010000:00010000:0.0:1787733964.775100:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.775112:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.775137:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.775146:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.775202:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.775210:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787733964.775221:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.775231:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.775245:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733964.775254:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5929 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733964.775312:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574689988224:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 50447us (50665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733964.775320:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:1.0:1787733964.788796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733964.788896:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689988736 00000100:00100000:0.0:1787733964.788906:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689988736 00000100:00100000:0.0:1787733964.789011:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1787733964.789023:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:10286:x1874574689988736:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:0.0:1787733964.789091:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d591b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19466 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787733964.789749:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787733964.789818:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787733964.790559:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787733964.790685:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.790711:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1943c expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.790720:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.790766:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1943c expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733964.790782:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1943c expref: 23 pid: 5832 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733964.790798:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1874574705749120:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733964.790954:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733964.801100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.801223:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1874574705749120:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733964.801251:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733964.801329:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689988864 00000100:00100000:3.0:1787733964.801337:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689988864 00010000:00010000:3.0:1787733964.801627:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1943c expref: 24 pid: 5832 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733964.801669:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:3.0:1787733964.801680:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:2355:x1874574689988864:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733964.801695:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733964.801707:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1943c expref: 24 pid: 5832 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.801721:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1943c expref: 24 pid: 5832 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.801743:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d58c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1943c expref: 24 pid: 5832 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.801769:0:11156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634d00) 00010000:00010000:3.0:1787733964.801774:0:11156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.801794:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.801801:0:11156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733964.801828:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733964.801887:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:2355:x1874574689988864:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 209us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733964.801895:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00010000:00010000:2.0:1787733964.802443:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.802452:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787733964.802587:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787733964.802821:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787733964.802927:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705749248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787733964.802977:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733964.803048:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37180 going to sleep for 11 seconds 00000100:00100000:3.0:1787733964.803457:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705749248 00000100:00100000:3.0:1787733964.803469:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705749248 00000100:00100000:3.0:1787733964.803579:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787733964.803589:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874574705749248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787733964.803670:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874574705749248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733964.803677:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787733964.803796:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705749248:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787733964.804459:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787733964.804517:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705749376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787733964.804553:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733964.804589:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37240 going to sleep for 11 seconds 00000100:00100000:1.0:1787733964.804772:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705749376 00000100:00100000:1.0:1787733964.804778:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705749376 00000100:00100000:1.0:1787733964.804805:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787733964.804812:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1874574705749376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787733964.804990:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874574705749376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 177us (435us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787733964.804997:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787733964.805141:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705749376:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787733964.805210:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787733964.805251:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.805261:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.805268:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.805274:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cdc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733964.805279:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.805286:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.805302:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634d00) 00010000:00010000:2.0:1787733964.805305:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787733964.805310:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.805316:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5930 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787733964.805656:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787733964.805898:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787733964.805911:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 282794754903ns, next at 283794752755ns, rc = 0 00000001:00080000:2.0:1787733964.805919:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787733964.805956:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634d00) 00010000:00010000:2.0:1787733964.805959:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787733964.805967:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d591b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19466 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733964.806134:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:10286:x1874574689988736:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 17113us (17347us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787733964.806143:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000020:00080000:2.0:1787733964.806148:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1787733964.806297:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787733964.815232:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.815433:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689988992 00000100:00100000:2.0:1787733964.815442:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689988992 00000100:00100000:2.0:1787733964.815548:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:2.0:1787733964.815560:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:10286:x1874574689988992:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733964.815584:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733964.815608:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5937 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1946d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.815667:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5937 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1946d expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.815681:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5937 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1946d expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733964.815699:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733964.815702:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787733964.815706:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030a00, rc 0) 00000100:00100000:2.0:1787733964.815778:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:10286:x1874574689988992:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 220us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733964.815785:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:3.0:1787733964.828358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733964.828614:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689989248 00000100:00100000:2.0:1787733964.828631:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689989248 00000100:00100000:2.0:1787733964.828721:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1787733964.828733:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec73d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:10286:x1874574689989248:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733964.830314:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec73d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:10286:x1874574689989248:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 1571us (1963us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787733964.830327:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1787733965.002974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733965.003691:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689989504 00000100:00100000:3.0:1787733965.003707:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689989504 00000100:00100000:3.0:1787733965.003802:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:3.0:1787733965.003816:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:10296:x1874574689989504:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733965.003854:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733965.003884:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d593e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19474 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733965.004046:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787733965.005378:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d593e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19474 expref: 30 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733965.005401:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:3.0:1787733965.005404:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787733965.005411:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d593e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19474 expref: 30 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733965.005432:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ed600, rc 0) 00000100:00100000:3.0:1787733965.006502:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:10296:x1874574689989504:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 2680us (3537us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787733965.006515:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:3.0:1787733965.015391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733965.015521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689989632 00000100:00100000:2.0:1787733965.015540:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689989632 00000100:00100000:2.0:1787733965.015611:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:2.0:1787733965.015622:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:10296:x1874574689989632:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1787733965.015716:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d594c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.015735:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d594c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.015750:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d594c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.015778:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.015786:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.015793:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.015927:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.015955:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.015963:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787733965.016005:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016018:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d594c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016025:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d594c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016032:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d594c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016037:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733965.016041:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d594c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016049:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d594c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016060:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733965.016063:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733965.016067:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d594c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016073:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d594c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016095:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016102:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5953 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016108:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016114:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733965.016117:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016123:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5953 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016132:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ee0dfca00) 00010000:00010000:2.0:1787733965.016135:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733965.016138:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5953 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016144:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016214:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016222:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016241:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016254:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733965.016257:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016263:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016271:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733965.016274:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733965.016277:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.016283:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d595a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733965.016638:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:10296:x1874574689989632:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1014us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733965.016650:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1787733965.031446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733965.031513:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689989888 00000100:00100000:2.0:1787733965.031531:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689989888 00000100:00100000:2.0:1787733965.031684:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1787733965.031699:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:10296:x1874574689989888:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733965.032852:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+30:10296:x1874574689989888:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 1150us (1416us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787733965.032862:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1787733965.109138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733965.109444:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689990144 00000100:00100000:2.0:1787733965.109454:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689990144 00000100:00100000:2.0:1787733965.109513:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1787733965.109531:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+30:10299:x1874574689990144:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733965.109558:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733965.109578:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5961 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1947b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.109658:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5968 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.109672:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5968 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.109683:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5968 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.109698:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d596f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.109705:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d596f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.109711:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d596f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.109849:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.109858:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.109865:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733965.109956:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787733965.110049:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5968 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110057:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5968 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110064:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5968 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110071:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733965.110076:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5968 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110085:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5968 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110097:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733965.110101:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733965.110105:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110111:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110125:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d596f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110131:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d596f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110148:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d596f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110197:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733965.110201:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d596f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110209:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d596f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110217:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ee0dfca00) 00010000:00010000:2.0:1787733965.110219:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733965.110222:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d596f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110456:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d596f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110500:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5961 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1947b expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110513:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1947b expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.110520:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733965.110522:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787733965.110524:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca800, rc 0) 00000100:00100000:2.0:1787733965.110637:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:10299:x1874574689990144:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1107us (1509us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787733965.110655:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:3.0:1787733965.126290:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733965.127037:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689990272 00000100:00100000:0.0:1787733965.127048:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689990272 00000100:00100000:0.0:1787733965.127113:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:0.0:1787733965.127125:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:10299:x1874574689990272:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787733965.127241:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5984 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.127260:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.127273:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.127303:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.127310:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5984 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.127318:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.127324:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733965.127329:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.127337:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5984 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.127350:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:0.0:1787733965.127353:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787733965.127358:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5984 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.127364:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5984 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733965.127451:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:10299:x1874574689990272:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 328us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733965.127459:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1787733965.129702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733965.129814:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689990528 00000100:00100000:0.0:1787733965.129824:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689990528 00000100:00100000:2.0:1787733965.129959:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1787733965.129971:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:10299:x1874574689990528:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733965.130362:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+33:10299:x1874574689990528:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 392us (668us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787733965.130371:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00010000:00010000:1.0:1787733965.242984:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733965.576248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733965.576372:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689990784 00000100:00100000:2.0:1787733965.576386:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689990784 00000100:00100000:2.0:1787733965.576466:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:2.0:1787733965.576478:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+33:10330:x1874574689990784:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1787733965.576519:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733965.576544:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d598b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19482 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.576674:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.576689:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.576709:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733965.576720:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787733965.576922:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d598b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19482 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.576981:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19482 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.576991:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733965.576994:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787733965.576998:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cbe00, rc 0) 00000100:00100000:2.0:1787733965.577149:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:10330:x1874574689990784:12345-192.168.201.34@tcp:101:cat.0 Request processed in 673us (918us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787733965.577208:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:2.0:1787733965.581770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733965.581822:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733965.581991:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689990912 00000100:00100000:0.0:1787733965.582005:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689990912 00000100:00100000:0.0:1787733965.582084:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1787733965.582094:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:2355:x1874574689990912:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733965.582113:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733965.582143:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5992 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19482 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.582180:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:0.0:1787733965.582186:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733965.582259:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:2355:x1874574689990912:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 165us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733965.582268:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1787733965.582464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689991168 00000100:00100000:1.0:1787733965.582469:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689991168 00000100:00100000:1.0:1787733965.582508:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1787733965.582518:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:10330:x1874574689991168:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:1.0:1787733965.582798:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:10330:x1874574689991168:12345-192.168.201.34@tcp:35:cat.0 Request processed in 281us (974us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787733965.582805:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1787733965.660115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733965.661112:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689991424 00000100:00100000:0.0:1787733965.661131:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689991424 00000100:00100000:0.0:1787733965.661234:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:0.0:1787733965.661248:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:10336:x1874574689991424:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:0.0:1787733965.661284:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733965.661288:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787733965.661330:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d58f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19458 expref: 35 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.661377:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:0.0:1787733965.661383:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787733965.661403:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d59a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19489 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.661553:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.661571:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1947b expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.661580:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.661624:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1947b expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.661640:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1947b expref: 35 pid: 5832 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733965.661659:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705749504:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733965.661812:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e23b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733965.665801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733965.665876:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705749504:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733965.665915:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733965.666262:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689991552 00000100:00100000:1.0:1787733965.666273:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689991552 00010000:00010000:1.0:1787733965.666328:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1947b expref: 36 pid: 5832 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733965.666370:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:1.0:1787733965.666382:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+36:2355:x1874574689991552:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733965.666402:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733965.666409:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1947b expref: 36 pid: 5832 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.666425:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1947b expref: 36 pid: 5832 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.666453:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1947b expref: 36 pid: 5832 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.666497:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:1.0:1787733965.666503:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.666515:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.666523:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.666591:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733965.666658:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:2355:x1874574689991552:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 277us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733965.666667:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00010000:00010000:0.0:1787733965.674225:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.674273:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733965.674308:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787733965.674545:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d59a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19489 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.674569:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19489 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733965.674580:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:0.0:1787733965.674583:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787733965.674588:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658e00, rc 0) 00000100:00100000:0.0:1787733965.674689:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:10336:x1874574689991424:12345-192.168.201.34@tcp:101:dd.0 Request processed in 13442us (14590us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787733965.674701:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1787733965.681922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733965.682044:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689991808 00000100:00100000:1.0:1787733965.682058:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689991808 00000100:00100000:1.0:1787733965.682137:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:1.0:1787733965.682150:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:10336:x1874574689991808:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:1.0:1787733965.682565:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.682599:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.682623:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787733965.683343:0:8190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787733965.683390:0:8190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099d1a175 reply state 000000009df976a3 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733965.683421:0:8190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787733965.684116:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:10336:x1874574689991808:12345-192.168.201.34@tcp:36:dd.0 Request processed in 1421us (1663us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787733965.684127:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000020:00080000:1.0:1787733965.684133:0:8190:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787733965.700581:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.700617:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.700627:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.700635:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733965.700643:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.700653:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.700680:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:1.0:1787733965.700684:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733965.700858:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.700867:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d59b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733965.976340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733965.976484:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689991936 00000100:00100000:2.0:1787733965.976500:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689991936 00000100:00100000:2.0:1787733965.976591:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1787733965.976605:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+37:10351:x1874574689991936:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:2.0:1787733965.976643:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733965.976677:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d59bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19490 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.976797:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d59c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.976815:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d59c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.976827:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d59c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.976866:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d59ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.976874:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d59ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.976880:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d59ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.977006:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.977019:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19489 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.977028:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.977072:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19489 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.977090:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19489 expref: 38 pid: 5834 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733965.977106:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705749632:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733965.977324:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733965.980060:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705749632:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733965.980120:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733965.981128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733965.981253:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689992192 00000100:00100000:1.0:1787733965.981263:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689992192 00000100:00100000:1.0:1787733965.981338:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1787733965.981350:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+39:5591:x1874574689992192:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787733965.982006:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+40:5591:x1874574689992192:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 655us (879us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787733965.982016:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1787733965.989507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733965.989882:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689992320 00000100:00100000:1.0:1787733965.989896:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689992320 00010000:00010000:1.0:1787733965.989957:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19489 expref: 40 pid: 5834 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733965.990067:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:1.0:1787733965.990080:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+40:2354:x1874574689992320:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733965.990101:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733965.990109:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19489 expref: 40 pid: 5834 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.990126:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19489 expref: 40 pid: 5834 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.990192:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d59a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19489 expref: 40 pid: 5834 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.990241:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:1.0:1787733965.990247:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.990257:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.990265:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733965.990302:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733965.990375:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+39:2354:x1874574689992320:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 298us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733965.990384:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00010000:00010000:2.0:1787733965.990909:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.990932:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733965.991010:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787733965.991015:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733965.991068:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991083:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991093:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d59c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991101:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d59c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991108:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d59c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991115:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733965.991121:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d59c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991130:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d59c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991142:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733965.991145:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733965.991149:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d59c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991213:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d59c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991228:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d59ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991235:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d59ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991240:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d59ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991245:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733965.991248:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d59ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991253:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d59ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991261:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ee0dfca00) 00010000:00010000:2.0:1787733965.991263:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733965.991266:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d59ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991272:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d59ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991317:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d59bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19490 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991332:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19490 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733965.991346:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733965.991349:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787733965.991352:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031000, rc 0) 00000100:00100000:2.0:1787733965.991394:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:10351:x1874574689991936:12345-192.168.201.34@tcp:101:stat.0 Request processed in 14792us (15071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733965.991403:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1787733966.092543:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733966.092724:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689992576 00000100:00100000:3.0:1787733966.092750:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689992576 00000100:00080000:0.0:1787733966.092847:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733966.092858:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:3.0:1787733966.092873:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:10357:x1874574689992576:12345-192.168.201.34@tcp:36:truncate.0 00010000:00010000:3.0:1787733966.093761:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733966.093808:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d59d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19490 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733966.093833:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:3.0:1787733966.093855:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733966.094124:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733966.094141:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733966.094151:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787733966.094250:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787733966.094273:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ff0557a reply state 0000000083dc62df transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733966.094283:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787733966.094434:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+40:10357:x1874574689992576:12345-192.168.201.34@tcp:36:truncate.0 Request processed in 1565us (1906us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787733966.094444:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000020:00080000:3.0:1787733966.094450:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787733966.098579:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.098603:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.098611:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.098618:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ed600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733966.098623:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.098632:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.098654:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733966.098657:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733966.098662:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.098669:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d59d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733966.260093:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733966.262046:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689992704 00000100:00100000:0.0:1787733966.262066:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689992704 00000100:00100000:0.0:1787733966.262196:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:0.0:1787733966.262209:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+39:10371:x1874574689992704:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:0.0:1787733966.262243:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733966.262271:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d59df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19497 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262370:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d59e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262413:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d59e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262427:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d59e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262446:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d59ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262454:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d59ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262461:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d59ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262597:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262607:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262615:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733966.262659:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787733966.262664:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733966.262704:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262719:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262750:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d59e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262757:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d59e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262765:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d59e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262772:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733966.262776:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d59e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262784:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d59e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262799:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:0.0:1787733966.262802:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733966.262808:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d59e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262814:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d59e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262830:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d59ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262836:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d59ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262840:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d59ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262853:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733966.262856:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d59ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262861:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d59ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262869:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec6771600) 00010000:00010000:0.0:1787733966.262872:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733966.262875:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d59ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262881:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d59ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262920:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d59df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19497 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262935:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19497 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.262944:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:0.0:1787733966.262947:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733966.262949:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659000, rc 0) 00000100:00100000:0.0:1787733966.263406:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+40:10371:x1874574689992704:12345-192.168.201.34@tcp:101:stat.0 Request processed in 1196us (3322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733966.263417:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00010000:00010000:2.0:1787733966.266911:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733966.352607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.352950:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689992960 00000100:00100000:2.0:1787733966.352964:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689992960 00000100:00100000:2.0:1787733966.353252:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:2.0:1787733966.353266:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+40:10381:x1874574689992960:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733966.353296:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733966.353327:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d59fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1949e expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733966.353491:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787733966.353697:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d59fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1949e expref: 42 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.353715:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:2.0:1787733966.353719:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787733966.353724:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d59fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1949e expref: 42 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.353751:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030800, rc 0) 00000100:00100000:2.0:1787733966.353844:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+41:10381:x1874574689992960:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 581us (1250us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787733966.353853:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:1.0:1787733966.362802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733966.362954:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689993216 00000100:00100000:0.0:1787733966.363049:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689993216 00000100:00100000:0.0:1787733966.363210:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787733966.363223:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+41:10381:x1874574689993216:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787733966.363914:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+42:10381:x1874574689993216:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 691us (1128us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787733966.363924:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1787733966.459665:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.459879:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689993472 00000100:00100000:2.0:1787733966.459892:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689993472 00000100:00100000:2.0:1787733966.459968:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1787733966.459989:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+42:10387:x1874574689993472:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733966.460038:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733966.460066:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.460237:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.460254:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19497 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.460264:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.460311:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19497 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.460327:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19497 expref: 43 pid: 5834 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733966.460343:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705749760:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733966.460464:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787733966.465400:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705749760:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733966.465688:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733966.468727:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.469917:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689993600 00000100:00100000:2.0:1787733966.469933:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689993600 00010000:00010000:2.0:1787733966.470007:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19497 expref: 44 pid: 5834 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733966.470082:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:2.0:1787733966.470093:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+44:2355:x1874574689993600:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733966.470124:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733966.470133:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19497 expref: 44 pid: 5834 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.470150:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19497 expref: 44 pid: 5834 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.470213:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d59f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19497 expref: 44 pid: 5834 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.470236:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733966.470242:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.470253:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.470262:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.470301:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733966.470389:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+43:2355:x1874574689993600:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 297us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733966.470399:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00010000:00010000:3.0:1787733966.473531:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733966.473790:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733966.473820:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787733966.474117:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194a5 expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733966.474147:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194a5 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733966.474343:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:3.0:1787733966.474347:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787733966.474352:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030c00, rc 0) 00000100:00100000:1.0:1787733966.478237:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+43:10387:x1874574689993472:12345-192.168.201.34@tcp:101:bash.0 Request processed in 18238us (18565us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787733966.478255:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1787733966.481470:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733966.482085:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689993856 00000100:00100000:3.0:1787733966.482099:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689993856 00000100:00100000:3.0:1787733966.482309:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1787733966.482324:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+43:10387:x1874574689993856:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:3.0:1787733966.483070:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733966.483097:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733966.483112:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787733966.483298:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1787733966.483329:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060cb94df reply state 000000008ca1d752 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733966.483339:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787733966.483484:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:10387:x1874574689993856:12345-192.168.201.34@tcp:36:bash.0 Request processed in 1161us (2027us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787733966.483495:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000020:00080000:3.0:1787733966.483837:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787733966.492038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:1.0:1787733966.492049:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.492066:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.492076:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.492090:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ede00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733966.492097:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.492106:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.492129:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:1.0:1787733966.492133:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733966.492139:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.492145:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5a1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733966.492324:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689993984 00000100:00100000:0.0:1787733966.492339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689993984 00000100:00100000:0.0:1787733966.492411:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:0.0:1787733966.492423:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+45:10387:x1874574689993984:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787733966.492451:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733966.492474:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5a25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.492972:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.492992:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194a5 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.493003:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.493050:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194a5 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.493067:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194a5 expref: 46 pid: 5833 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733966.493102:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705749888:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733966.493845:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e23180 going to sleep for 11 seconds 00000100:00100000:0.0:1787733966.499319:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733966.499377:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689994112 00000100:00100000:3.0:1787733966.499390:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689994112 00010000:00010000:3.0:1787733966.499449:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194a5 expref: 47 pid: 5833 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733966.499596:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:0.0:1787733966.499613:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:2355:x1874574689994112:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733966.499636:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733966.499645:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194a5 expref: 47 pid: 5833 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.499662:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194a5 expref: 47 pid: 5833 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.499692:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:0.0:1787733966.499698:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.499711:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.499719:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.499755:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733966.499828:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:2355:x1874574689994112:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 220us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733966.499837:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00010000:00010000:1.0:1787733966.499887:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194a5 expref: 46 pid: 5833 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733966.499909:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705749888:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733966.499936:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.499946:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.499953:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733966.500017:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787733966.500030:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787733966.500066:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.500106:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5a25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194ac expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.500122:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194ac expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733966.500131:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:1.0:1787733966.500133:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787733966.500136:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658600, rc 0) 00000100:00100000:1.0:1787733966.500390:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+45:10387:x1874574689993984:12345-192.168.201.34@tcp:101:bash.0 Request processed in 7969us (8370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733966.500399:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:1.0:1787733966.512443:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733966.514002:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689994368 00000100:00100000:3.0:1787733966.514017:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689994368 00000100:00100000:3.0:1787733966.514089:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1787733966.514101:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec73d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+45:10387:x1874574689994368:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:3.0:1787733966.514461:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec73d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:10387:x1874574689994368:12345-192.168.201.34@tcp:35:bash.0 Request processed in 362us (2036us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787733966.514469:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1787733966.603350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733966.603458:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689994624 00000100:00100000:3.0:1787733966.603471:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689994624 00000100:00100000:3.0:1787733966.603564:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1787733966.603575:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:10397:x1874574689994624:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733966.603619:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733966.603652:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5a33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194b3 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733966.603832:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787733966.603981:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5a33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194b3 expref: 48 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733966.603995:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:3.0:1787733966.603997:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787733966.604001:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5a33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194b3 expref: 48 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733966.604016:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec600, rc 0) 00000100:00100000:3.0:1787733966.604103:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:10397:x1874574689994624:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 529us (771us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1787733966.604111:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:1.0:1787733966.610442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.610835:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689994752 00000100:00100000:2.0:1787733966.610849:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689994752 00000100:00100000:2.0:1787733966.610929:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:2.0:1787733966.610941:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:10397:x1874574689994752:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1787733966.611054:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.611076:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.611092:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.611112:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.611120:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.611127:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612374:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612393:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612405:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787733966.612492:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612509:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612516:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612523:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612530:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733966.612535:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612606:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612623:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733966.612627:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733966.612633:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612640:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612661:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612668:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612682:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612688:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733966.612691:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612697:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612705:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ee0dfca00) 00010000:00010000:2.0:1787733966.612708:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733966.612711:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612717:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612747:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612754:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612761:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612767:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733966.612771:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612788:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612798:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733966.612800:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733966.612804:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.612810:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733966.612984:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:10397:x1874574689994752:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 2038us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733966.612997:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1787733966.617047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733966.617136:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689995008 00000100:00100000:0.0:1787733966.617196:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689995008 00000100:00100000:0.0:1787733966.617268:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1787733966.617293:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:10397:x1874574689995008:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787733966.618011:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+48:10397:x1874574689995008:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 729us (977us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787733966.618022:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1787733966.663314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.663602:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689995264 00000100:00100000:2.0:1787733966.663618:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689995264 00000100:00100000:2.0:1787733966.663701:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:2.0:1787733966.663714:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+48:10400:x1874574689995264:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733966.663797:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733966.663824:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194ba expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.663923:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.663940:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.663952:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.663982:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.663990:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.663997:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664150:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5a6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664203:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664210:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733966.664220:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787733966.664333:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664342:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664349:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664355:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733966.664360:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664381:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664396:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733966.664399:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733966.664404:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664411:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664599:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664607:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664613:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664618:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733966.664621:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664627:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664636:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ee0dfca00) 00010000:00010000:2.0:1787733966.664638:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733966.664641:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664656:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664709:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194ba expref: 51 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664723:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194ba expref: 50 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.664742:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733966.664745:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787733966.664748:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:2.0:1787733966.664833:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:10400:x1874574689995264:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1121us (1534us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787733966.664842:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1787733966.673334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.673567:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689995392 00000100:00100000:2.0:1787733966.673581:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689995392 00000100:00100000:2.0:1787733966.673658:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:2.0:1787733966.673672:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:10400:x1874574689995392:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1787733966.673787:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.673810:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.673824:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.673885:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.673893:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.673901:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.673909:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733966.673914:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.673923:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.673939:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733966.673942:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787733966.673947:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.673954:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733966.674056:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:10400:x1874574689995392:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 386us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733966.674065:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:3.0:1787733966.676144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733966.676863:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689995520 00000100:00100000:0.0:1787733966.676876:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689995520 00000100:00100000:0.0:1787733966.676956:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1787733966.676969:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:2355:x1874574689995520:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733966.676989:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733966.677023:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5a6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194ba expref: 50 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733966.677048:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:0.0:1787733966.677055:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733966.677141:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+49:2355:x1874574689995520:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 173us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733966.677150:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1787733966.678889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.679339:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689995776 00000100:00100000:2.0:1787733966.679353:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689995776 00000100:00100000:2.0:1787733966.679422:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:2.0:1787733966.679461:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+49:10400:x1874574689995776:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733966.680060:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:10400:x1874574689995776:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 600us (1180us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787733966.680068:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1787733966.929708:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.930028:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689996032 00000100:00100000:2.0:1787733966.930042:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689996032 00000100:00100000:2.0:1787733966.930125:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:2.0:1787733966.930139:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:10418:x1874574689996032:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1787733966.930277:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733966.930315:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194c1 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.930455:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.930474:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.930488:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733966.930501:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787733966.931274:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194c1 expref: 53 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.931628:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194c1 expref: 52 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.931666:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733966.931669:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787733966.931674:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031000, rc 0) 00000100:00100000:2.0:1787733966.931775:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10418:x1874574689996032:12345-192.168.201.34@tcp:101:cat.0 Request processed in 1638us (2083us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787733966.931784:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:3.0:1787733966.960223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.960360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689996160 00000100:00100000:2.0:1787733966.960374:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689996160 00000100:00100000:2.0:1787733966.960451:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:2.0:1787733966.960464:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10419:x1874574689996160:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733966.960495:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733966.960521:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194c8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.960618:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.960636:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.960648:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733966.960742:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787733966.960746:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733966.960775:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.960836:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5a95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194c8 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.960859:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194c8 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.960870:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733966.960873:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787733966.960877:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030c00, rc 0) 00000100:00100000:2.0:1787733966.960956:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10419:x1874574689996160:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 495us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733966.960964:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:3.0:1787733966.966667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.966897:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689996544 00000100:00100000:2.0:1787733966.966910:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689996544 00000100:00100000:2.0:1787733966.966989:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1787733966.967001:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10419:x1874574689996544:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733966.967462:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10419:x1874574689996544:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 461us (810us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787733966.967472:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1787733966.970346:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.970790:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689996672 00000100:00100000:2.0:1787733966.970802:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689996672 00000100:00100000:2.0:1787733966.970894:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:2.0:1787733966.970906:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10419:x1874574689996672:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:2.0:1787733966.970925:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787733966.970958:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5a2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194ac expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.971008:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5a87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194c1 expref: 53 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.971025:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5937 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1946d expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.971039:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733966.971053:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733966.971131:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+51:10419:x1874574689996672:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 226us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733966.971139:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1787733966.974667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733966.974832:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689996800 00000100:00100000:2.0:1787733966.974845:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689996800 00000100:00100000:2.0:1787733966.974923:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:2.0:1787733966.974935:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+51:10419:x1874574689996800:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:2.0:1787733966.975122:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5aa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.975144:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733966.975330:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787733966.975866:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787733966.976083:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787733966.976669:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787733966.976888:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+51:10419:x1874574689996800:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 1949us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733966.976900:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:3.0:1787733967.010876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733967.011054:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689996928 00000100:00100000:2.0:1787733967.011068:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689996928 00000100:00100000:2.0:1787733967.011193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:2.0:1787733967.011208:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+51:10421:x1874574689996928:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733967.011239:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733967.011267:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5aaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011389:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5ab1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011407:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011421:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011440:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5ab8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011447:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011454:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011752:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011774:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011782:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733967.011831:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787733967.011835:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733967.011860:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011874:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011883:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011890:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5ab1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011897:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011904:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733967.011910:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011918:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5ab1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011932:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733967.011935:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733967.011947:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5ab1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011954:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5ab1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011973:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011980:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011986:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.011992:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733967.011995:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.012002:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.012011:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ee0dfc100) 00010000:00010000:2.0:1787733967.012013:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733967.012016:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5ab8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.012021:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5ab8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.012062:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5aaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194cf expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.012095:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194cf expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733967.012104:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfca00) 00010000:00010000:2.0:1787733967.012106:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787733967.012109:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca800, rc 0) 00000100:00100000:2.0:1787733967.012371:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10421:x1874574689996928:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1165us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733967.012382:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00010000:00010000:3.0:1787733967.292418:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733967.476358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733967.476447:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733967.476478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733967.476511:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689997312 00000100:00100000:1.0:1787733967.476517:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689997184 00000100:00100000:3.0:1787733967.476521:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689997312 00000100:00100000:1.0:1787733967.476524:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689997184 00000100:00100000:1.0:1787733967.476593:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1787733967.476604:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574689997184:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733967.476674:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574689997184:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733967.476683:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:0.0:1787733967.476685:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689997056 00000100:00100000:0.0:1787733967.476691:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689997056 00000100:00100000:3.0:1787733967.476848:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:3.0:1787733967.476857:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574689997312:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733967.476986:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 277 00000100:00100000:0.0:1787733967.476998:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574689997056:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733967.477034:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574689997056:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733967.477041:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 277 00000100:00080000:0.0:1787733967.477078:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787733967.477082:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787733967.477285:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574689997312:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 429us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733967.477292:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:3.0:1787733967.675621:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705750144:0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.675729:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733967.675800:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705750656:0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.675842:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733967.675879:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787733967.675885:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705750016:0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.675916:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733967.675936:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705750528:0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.675956:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733967.676008:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705750144 00000100:00100000:3.0:1787733967.676018:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705750144 00000100:00100000:3.0:1787733967.676068:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705750528 00000100:00100000:3.0:1787733967.676071:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705750528 00000100:00100000:3.0:1787733967.676116:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787733967.676125:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705750144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.676217:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705750144:12345-0@lo:400:kworker.0 Request processed in 93us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733967.676225:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787733967.676243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787733967.676250:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705750528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.676276:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705750528:12345-0@lo:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733967.676282:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787733967.676302:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705750656 00000100:00100000:3.0:1787733967.676306:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705750656 00000100:00100000:3.0:1787733967.676332:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787733967.676339:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874574705750656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.676385:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874574705750656:12345-0@lo:400:kworker.0 Request processed in 46us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733967.676399:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787733967.676418:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705750016 00000100:00100000:3.0:1787733967.676421:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705750016 00000100:00100000:3.0:1787733967.676443:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787733967.676450:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705750016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.676481:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705750016:12345-0@lo:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733967.676487:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787733967.676562:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705750016:0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.676578:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705750528:0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.676587:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705750144:0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.676597:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705750656:0@lo:400:kworker.0 00000100:00080000:0.0:1787733967.677021:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787733967.677028:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733967.677227:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705750272:0@lo:400:kworker.0 00000100:00100000:1.0:1787733967.677288:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733967.677329:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787733967.677336:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705750400:0@lo:400:kworker.0 00000100:00100000:1.0:1787733967.677361:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733967.677647:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705750272 00000100:00100000:3.0:1787733967.677654:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705750272 00000100:00100000:3.0:1787733967.677698:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787733967.677706:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705750272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733967.677769:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705750272:12345-0@lo:400:kworker.0 Request processed in 63us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733967.677776:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787733967.677816:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705750272:0@lo:400:kworker.0 00000100:00100000:0.0:1787733967.677970:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705750400 00000100:00100000:0.0:1787733967.677975:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705750400 00000100:00100000:0.0:1787733967.678021:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787733967.678029:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705750400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733967.678071:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705750400:12345-0@lo:400:kworker.0 Request processed in 43us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733967.678289:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787733967.678325:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705750400:0@lo:400:kworker.0 00000100:00080000:1.0:1787733967.678481:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787733967.678487:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787733967.788572:0:11981:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733967.788584:0:11981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787733967.788624:0:11981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787733967.788631:0:11981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787733967.994412:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787733967.994421:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787733967.994470:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787733967.994477:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787733967.994630:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705750784:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787733967.995090:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efe973d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787733967.998012:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733967.998112:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689997440 00000100:00100000:1.0:1787733967.998122:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689997440 00000100:00100000:1.0:1787733967.998220:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1787733967.998231:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10433:x1874574689997440:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787733967.998328:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10433:x1874574689997440:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 Request processed in 99us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733967.998336:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:0.0:1787733967.998922:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705750784:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787733968.006940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733968.007109:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689997568 00000100:00100000:0.0:1787733968.007120:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689997568 00000100:00100000:0.0:1787733968.007284:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:0.0:1787733968.007309:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10433:x1874574689997568:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787733968.007342:0:8190:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787733968.007447:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10433:x1874574689997568:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 153us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733968.007455:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00080000:1.0:1787733968.008113:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733968.013143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.013393:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689997696 00000100:00100000:3.0:1787733968.013422:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689997696 00000100:00100000:3.0:1787733968.013538:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:3.0:1787733968.013550:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10433:x1874574689997696:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787733968.013638:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5ac6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013656:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013669:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013717:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5acd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013725:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013731:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013756:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013764:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013771:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733968.013812:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787733968.013816:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787733968.013836:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013849:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013855:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5ac6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013862:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013868:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733968.013873:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013880:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5ac6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013892:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:3.0:1787733968.013895:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733968.013900:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5ac6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.013906:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5ac6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014236:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014247:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5acd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014253:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5acd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014264:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733968.014268:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5acd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014274:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5acd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014282:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff891ec6634e00) 00010000:00010000:3.0:1787733968.014285:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733968.014288:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5acd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014294:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5acd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014311:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014318:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014323:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014327:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733968.014329:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014335:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014352:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfca00) 00010000:00010000:3.0:1787733968.014355:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733968.014358:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.014364:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5ad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733968.014440:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10433:x1874574689997696:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 887us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733968.014449:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:0.0:1787733968.019265:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.019761:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689997952 00000100:00100000:3.0:1787733968.019777:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689997952 00000100:00100000:3.0:1787733968.019841:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:3.0:1787733968.019850:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10433:x1874574689997952:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733968.019870:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733968.019888:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5adb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194d6 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.019986:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.019999:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.020008:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733968.020015:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787733968.020120:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.020125:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.020139:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.020144:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ede00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733968.020147:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.020193:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.020210:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfca00) 00010000:00010000:3.0:1787733968.020214:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787733968.020219:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5ae2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.020226:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.020445:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5adb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194d6 expref: 54 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.020458:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:2.0:1787733968.020460:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787733968.020464:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5adb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194d6 expref: 54 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.020475:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec200, rc 0) 00000100:00100000:2.0:1787733968.020537:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10433:x1874574689997952:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 687us (1282us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787733968.020544:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:2.0:1787733968.022655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.022759:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689998080 00000100:00100000:3.0:1787733968.022768:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689998080 00000100:00100000:3.0:1787733968.022828:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:3.0:1787733968.022838:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10433:x1874574689998080:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787733968.022877:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787733968.022969:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10433:x1874574689998080:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 132us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733968.022993:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:3.0:1787733968.033947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733968.034060:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689998336 00000100:00100000:2.0:1787733968.034072:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689998336 00000100:00100000:2.0:1787733968.034137:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:2.0:1787733968.034198:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10433:x1874574689998336:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787733968.034220:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733968.034224:0:8190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787733968.034251:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5a9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194c8 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.034271:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733968.034276:0:8190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787733968.034291:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5af0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194dd expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787733968.034771:0:8190:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787733968.035041:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5af7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.035061:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.035073:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.035137:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5af0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194dd expref: 55 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.035205:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194dd expref: 54 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.035226:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:2.0:1787733968.035229:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787733968.035241:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cbe00, rc 0) 00000100:00100000:2.0:1787733968.035305:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10433:x1874574689998336:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1148us (1369us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787733968.035314:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:2.0:1787733968.039483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.039648:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689998592 00000100:00100000:3.0:1787733968.039659:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689998592 00000100:00100000:3.0:1787733968.039752:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:3.0:1787733968.039765:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10433:x1874574689998592:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787733968.039829:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733968.039858:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5af7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194dd expref: 54 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.039879:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc100) 00010000:00010000:3.0:1787733968.039892:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733968.039916:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.039929:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.039938:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.039952:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf8b69ffc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.039959:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf8b69ffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.039966:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf8b69ffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040066:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040073:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040080:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040085:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ede00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733968.040090:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040097:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040106:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:3.0:1787733968.040109:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733968.040112:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040118:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040140:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf8b69ffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040147:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf8b69ffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040180:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf8b69ffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040192:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733968.040195:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf8b69ffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040200:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf8b69ffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040208:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf8b69ffc (ffff891ec6634e00) 00010000:00010000:3.0:1787733968.040211:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733968.040214:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf8b69ffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.040219:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf8b69ffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733968.040306:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10433:x1874574689998592:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 543us (1168us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787733968.040316:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:1.0:1787733968.044305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733968.044428:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689998720 00000100:00100000:2.0:1787733968.044436:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689998720 00000100:00100000:2.0:1787733968.044490:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:2.0:1787733968.044502:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10433:x1874574689998720:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787733968.044526:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733968.044554:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5b13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194e4 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.044587:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.044598:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.044606:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.044692:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5b13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194e4 expref: 55 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.044722:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194e4 expref: 54 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.044731:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc500) 00010000:00010000:2.0:1787733968.044742:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787733968.044746:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:2.0:1787733968.044808:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10433:x1874574689998720:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 307us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733968.044816:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:2.0:1787733968.048458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.048527:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689998976 00000100:00100000:3.0:1787733968.048537:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689998976 00000100:00100000:3.0:1787733968.048590:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:3.0:1787733968.048601:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10433:x1874574689998976:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787733968.048685:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.048699:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.048725:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787733968.049450:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787733968.049461:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286038304278ns, next at 287038301995ns, rc = 0 00000004:00010000:3.0:1787733968.051403:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b26f26a9 reply state 000000008fb80699 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733968.051431:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787733968.051897:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:10433:x1874574689998976:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 3292us (3442us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787733968.051908:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:0.0:1787733968.054938:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.055032:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689999104 00000100:00100000:3.0:1787733968.055047:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689999104 00000100:00100000:3.0:1787733968.055128:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:3.0:1787733968.055151:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:10433:x1874574689999104:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733968.055216:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733968.055240:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194eb expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.055322:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194eb expref: 57 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.055340:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194eb expref: 57 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.055365:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc500) 00010000:00010000:3.0:1787733968.055369:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787733968.055373:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec000, rc 0) 00000100:00100000:3.0:1787733968.055449:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:10433:x1874574689999104:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 300us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733968.055458:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00010000:00010000:2.0:1787733968.058370:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.058389:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.058396:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.058402:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ede00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733968.058407:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.058415:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.058434:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc500) 00010000:00010000:2.0:1787733968.058438:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787733968.058443:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.058450:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733968.059949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.060030:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689999232 00000100:00100000:3.0:1787733968.060053:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689999232 00000100:00100000:3.0:1787733968.060102:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1787733968.060110:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1874574689999232:12345-192.168.201.34@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787733968.060191:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:3.0:1787733968.060226:0:6682:0:(genops.c:1385:class_connect()) connect: client a2c26bfa-a021-441a-9db5-0c3742b5640d, cookie 0x45228d86de4d5b2f 00002000:00100000:3.0:1787733968.060239:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a2c26bfa-a021-441a-9db5-0c3742b5640d/ffff891efe87f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787733968.060265:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787733968.060658:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787733968.060690:0:6682:0:(import.c:65:import_set_state_nolock()) ffff891efe87a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787733968.060811:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2353:x1874574689999232:12345-192.168.201.34@tcp:8:lhsmtool_posix.0 Request processed in 700us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733968.060820:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1787733968.062980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733968.063093:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689999360 00000100:00100000:0.0:1787733968.063101:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689999360 00000100:00100000:0.0:1787733968.063533:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1787733968.063548:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:0:x1874574689999360:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787733968.068837:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787733968.083863:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1787733968.083879:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000100:00100000:3.0:1787733968.084319:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:0:x1874574689999360:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 20769us (21340us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787733968.084331:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:2.0:1787733968.088937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733968.089565:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689999616 00000100:00100000:0.0:1787733968.089576:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689999616 00000100:00100000:0.0:1787733968.089630:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787733968.089640:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:10433:x1874574689999616:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787733968.089890:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:10433:x1874574689999616:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 250us (963us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787733968.089899:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787733968.095913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.096146:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574689999872 00000100:00100000:3.0:1787733968.096192:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574689999872 00000100:00100000:3.0:1787733968.096253:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:3.0:1787733968.096263:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:10433:x1874574689999872:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787733968.096376:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:10433:x1874574689999872:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 114us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733968.096384:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:3.0:1787733968.098446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733968.100684:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690000000 00000100:00100000:0.0:1787733968.100697:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690000000 00000100:00100000:1.0:1787733968.101884:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:1.0:1787733968.101897:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:10433:x1874574690000000:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787733968.101918:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733968.101941:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194f2 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.102033:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.102049:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.102061:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733968.102096:0:8190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787733968.102116:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.102984:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f2 expref: 59 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.103015:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f2 expref: 58 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.103026:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc500) 00010000:00010000:1.0:1787733968.103029:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787733968.103033:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cdc00, rc 0) 00000100:00100000:1.0:1787733968.103402:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:10433:x1874574690000000:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1505us (4961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733968.103411:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:0.0:1787733968.107741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.107836:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690000128 00000100:00100000:3.0:1787733968.107861:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690000128 00000100:00100000:3.0:1787733968.107957:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1787733968.107968:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574690000128:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733968.107988:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733968.108013:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002692d764/0x45228d86de4d5b44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df194f9 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787733968.108040:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ea7d0, blocks: 0x1 00010000:00010000:3.0:1787733968.108058:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1787733968.108062:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733968.108073:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002692d764/0x45228d86de4d5b44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f9 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.108093:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002692d764/0x45228d86de4d5b44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f9 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.108109:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec600, rc 0) 00000100:00100000:3.0:1787733968.108276:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574690000128:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 308us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733968.108283:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1787733968.110998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.111099:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690000384 00000100:00100000:3.0:1787733968.111108:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690000384 00000100:00100000:3.0:1787733968.111393:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:3.0:1787733968.111403:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:10433:x1874574690000384:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787733968.111506:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:10433:x1874574690000384:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 104us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733968.111535:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:2.0:1787733968.115682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.115867:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690000512 00000100:00100000:3.0:1787733968.115878:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690000512 00000100:00100000:3.0:1787733968.115937:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1787733968.115947:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:10433:x1874574690000512:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733968.115964:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733968.115984:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19500 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.116016:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002692d764/0x45228d86de4d5b44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f9 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.116025:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733968.116030:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733968.116035:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.116071:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002692d764/0x45228d86de4d5b44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f9 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.116085:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002692d764/0x45228d86de4d5b44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f9 expref: 7 pid: 6682 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733968.116099:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874574705750912:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733968.116653:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec60eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787733968.119497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733968.119594:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690000640 00000100:00100000:1.0:1787733968.119604:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690000640 00010000:00010000:1.0:1787733968.119646:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002692d764/0x45228d86de4d5b44 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f9 expref: 8 pid: 6682 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733968.119723:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1787733968.119733:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2355:x1874574690000640:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733968.119750:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733968.119777:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002692d764/0x45228d86de4d5b44 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f9 expref: 8 pid: 6682 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.119793:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002692d764/0x45228d86de4d5b44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f9 expref: 8 pid: 6682 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.119820:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733968.119825:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733968.119834:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.119845:0:11156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.119883:0:11156:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733968.119897:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11156:1874574705751040:192.168.201.34@tcp:105: 00000100:00100000:1.0:1787733968.119982:0:11156:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38840 going to sleep for 11 seconds 00010000:00010000:2.0:1787733968.120110:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002692d764/0x45228d86de4d5b44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f9 expref: 8 pid: 6682 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733968.120144:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874574705750912:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733968.120205:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.120217:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ed600, rc 0) 00000100:00100000:2.0:1787733968.120246:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:10433:x1874574690000512:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 4301us (4574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733968.120254:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:1.0:1787733968.123217:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11156:1874574705751040:192.168.201.34@tcp:105: 00010000:00010000:1.0:1787733968.123257:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733968.123324:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574690000640:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 3592us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733968.123335:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:3.0:1787733968.126026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733968.126193:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690000768 00000100:00100000:0.0:1787733968.126204:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690000768 00002000:00100000:0.0:1787733968.126255:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff891efef68700 x1874574690000768/t0(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:434/0 lens 504/0 e 0 to 0 dl 1787733979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787733968.126265:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891efef68700 with x1874574690000768 ext(0->8) 00002000:00010000:0.0:1787733968.126272:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891efef68700 00000100:00100000:0.0:1787733968.126296:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787733968.126313:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574690000768:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787733968.126983:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2354:x1874574690000768:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 670us (966us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787733968.126991:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00002000:00100000:0.0:1787733968.126999:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff891efef68700 x1874574690000768/t4294967302(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:434/0 lens 504/448 e 0 to 0 dl 1787733979 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787733968.127009:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891efef68700 with x1874574690000768 ext(0->8) 00002000:00010000:0.0:1787733968.127013:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891efef68700 00000100:00100000:0.0:1787733968.129897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.129984:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690000896 00000100:00100000:3.0:1787733968.130003:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690000896 00000100:00100000:3.0:1787733968.130060:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:3.0:1787733968.130070:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:10433:x1874574690000896:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787733968.163488:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:10433:x1874574690000896:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 33408us (33587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733968.163502:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000001:00080000:0.0:1787733968.163548:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787733968.163606:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787733968.163633:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff891ec3d37180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787733968.163639:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891efee40d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff891ec3d37e40 00000020:00080000:0.0:1787733968.163642:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891efee40c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff891efeb3ac00 00000004:00080000:0.0:1787733968.163664:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787733968.163713:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787733968.163838:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787733968.163939:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705751168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787733968.163997:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733968.164049:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705751168 00000100:00100000:0.0:1787733968.164056:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705751168 00000100:00100000:0.0:1787733968.164096:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787733968.164120:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705751168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787733968.164698:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787733968.164713:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787733968 00002000:00010000:0.0:1787733968.164716:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787733968.164718:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787733968 -> 1787733968 00002000:00010000:0.0:1787733968.164721:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787733968.164759:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705751168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 640us (761us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787733968.164767:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787733968.164794:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705751296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787733968.164824:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787733968.164883:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891efe90c700/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787733968.164889:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705751168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787733968.165004:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705751296 00000100:00100000:2.0:1787733968.165009:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705751296 00000100:00100000:2.0:1787733968.165045:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787733968.165052:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874574705751296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787733968.165068:0:6729:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787733968.165096:0:6729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8ea7cd, atime: 0x6a8ea7cd, ctime: 0x6a8ea7cd, blocks: 0x1 00010000:00010000:2.0:1787733968.165105:0:6729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f4e2742/0x45228d86de4d5b52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.165121:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1787733968.165145:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733968.165152:0:6729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f4e2742/0x45228d86de4d5b52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.165195:0:6729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f4e2742/0x45228d86de4d5b52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.165206:0:6729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f4e2742/0x45228d86de4d5b52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.165214:0:6729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f4e2742/0x45228d86de4d5b52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.165230:0:6729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787733968.165684:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1874574705751296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 631us (858us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787733968.165692:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1787733968.165832:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787733968.165839:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f4e2742/0x45228d86de4d5b52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.165848:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030a00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787733968.165853:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f4e2742/0x45228d86de4d5b52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.165862:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f4e2742/0x45228d86de4d5b52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.165883:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f4e2742/0x45228d86de4d5b52 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.165891:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f4e2742/0x45228d86de4d5b52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.165913:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733968.165915:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733968.165917:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787733968.165980:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891efe54dc00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787733968.165986:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705751296:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787733968.168429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733968.168640:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690001024 00000100:00100000:0.0:1787733968.168650:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690001024 00000100:00100000:0.0:1787733968.168748:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:0.0:1787733968.168758:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2357:x1874574690001024:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787733968.186941:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787733968.186963:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705751424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787733968.187035:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733968.187108:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705751424 00000100:00100000:3.0:1787733968.187116:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705751424 00000100:00100000:3.0:1787733968.187194:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787733968.187204:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705751424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787733968.187239:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733968.187283:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705751424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733968.187291:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787733968.187349:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705751424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787733968.202790:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2357:x1874574690001024:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 34020us (34356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733968.202805:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:0.0:1787733968.205484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.205663:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690001280 00000100:00100000:3.0:1787733968.205674:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690001280 00000100:00100000:3.0:1787733968.205749:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:3.0:1787733968.205760:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:10433:x1874574690001280:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787733968.205813:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733968.205841:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194f2 expref: 13 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.205862:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc500) 00010000:00010000:3.0:1787733968.205882:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733968.206009:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.206025:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.206035:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787733968.206644:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5cd91eb reply state 00000000cc0dbee3 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733968.206656:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787733968.206813:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:10433:x1874574690001280:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1052us (1337us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787733968.206821:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000001:00080000:2.0:1787733968.206902:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1787733968.206922:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1787733968.209934:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.209952:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.209960:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.209967:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7eda00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733968.209983:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.209991:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.210009:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc500) 00010000:00010000:2.0:1787733968.210013:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733968.210018:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.210024:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5b59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733968.210768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733968.210835:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690001408 00000100:00100000:2.0:1787733968.210846:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690001408 00000100:00100000:2.0:1787733968.210897:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:2.0:1787733968.210914:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574690001408:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787733968.211187:0:6729:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787733968.211190:0:6729:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787733968 -> 1787733967 00002000:00010000:2.0:1787733968.211193:0:6729:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787733965 00002000:00010000:2.0:1787733968.211196:0:6729:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787733968 -> 1787733967 00002000:00010000:2.0:1787733968.211198:0:6729:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787733968.211249:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690001408:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 343us (486us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787733968.211256:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:3.0:1787733968.213818:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733968.214088:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690001664 00000100:00100000:0.0:1787733968.214111:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690001664 00000100:00100000:0.0:1787733968.214203:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:0.0:1787733968.214214:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:10433:x1874574690001664:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787733968.214289:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.214306:0:8190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194e4 expref: 13 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.214316:0:8190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.214356:0:8190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194e4 expref: 13 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.214374:0:8190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194e4 expref: 13 pid: 8190 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733968.214389:0:8190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705751552:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733968.214481:0:8190:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed12ce000 going to sleep for 11 seconds 00000100:00100000:0.0:1787733968.216884:0:8190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705751552:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733968.216925:0:8190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733968.218431:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733968.218631:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690001792 00000100:00100000:2.0:1787733968.218641:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690001792 00010000:00010000:2.0:1787733968.218682:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194e4 expref: 14 pid: 8190 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733968.218754:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:2.0:1787733968.218766:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:2355:x1874574690001792:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733968.218785:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733968.218793:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194e4 expref: 14 pid: 8190 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.218809:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194e4 expref: 14 pid: 8190 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.218833:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194e4 expref: 14 pid: 8190 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.218852:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc500) 00010000:00010000:2.0:1787733968.218857:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.218868:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.218876:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.218918:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733968.218983:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:2355:x1874574690001792:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 219us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733968.218991:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00010000:00010000:0.0:1787733968.219765:0:8190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.219777:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.219815:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.219822:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.219828:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.219834:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733968.219838:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.219845:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.219856:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc500) 00010000:00010000:0.0:1787733968.219859:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787733968.219862:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.219868:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d5b60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733968.219929:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:10433:x1874574690001664:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 5715us (6118us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787733968.219938:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:3.0:1787733968.228983:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733968.229594:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690001920 00000100:00100000:0.0:1787733968.229606:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690001920 00000100:00100000:0.0:1787733968.229717:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787733968.229744:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690001920:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787733968.229794:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.229817:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.229827:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787733968.229832:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787733968.229837:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.229875:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.229890:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 7 pid: 6679 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733968.229905:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874574705751680:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733968.230033:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed12ce000 going to sleep for 11 seconds 00000100:00100000:3.0:1787733968.233202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733968.233320:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874574705751680:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733968.233354:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733968.233532:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690002048 00000100:00100000:1.0:1787733968.233540:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690002048 00010000:00010000:1.0:1787733968.233574:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 8 pid: 6679 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733968.233627:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:1.0:1787733968.233636:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2355:x1874574690002048:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733968.233651:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733968.233672:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 8 pid: 6679 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.233683:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 8 pid: 6679 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.233716:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4d8fb53/0x45228d86de4d5b4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19500 expref: 8 pid: 6679 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.233731:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787733968.233735:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787733968.233741:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.233749:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.233781:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733968.233917:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.233927:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.233952:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.233972:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.233981:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.233987:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787733968.233991:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.234000:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.234012:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.234019:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a2ca144/0x45228d86de4d5b67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733968.234648:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690002048:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 1010us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733968.234657:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:3.0:1787733968.234903:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574690001920:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 5161us (5932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733968.234913:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:3.0:1787733968.237629:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733968.237727:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690002304 00000100:00100000:0.0:1787733968.237748:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690002304 00000100:00100000:0.0:1787733968.237800:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:0.0:1787733968.237809:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:10433:x1874574690002304:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787733968.237887:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5b6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.237905:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.237915:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.238204:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.238216:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194eb expref: 13 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.238224:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.238257:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194eb expref: 13 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.238270:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194eb expref: 13 pid: 8190 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733968.238295:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705751808:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733968.238381:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed12ce000 going to sleep for 11 seconds 00000100:00100000:0.0:1787733968.240734:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705751808:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733968.240771:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733968.241613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733968.241687:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690002432 00000100:00100000:1.0:1787733968.241694:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690002432 00010000:00010000:1.0:1787733968.241738:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194eb expref: 14 pid: 8190 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733968.241773:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1787733968.241782:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:2355:x1874574690002432:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733968.241795:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733968.241801:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194eb expref: 14 pid: 8190 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.241813:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194eb expref: 14 pid: 8190 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.241834:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5b28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194eb expref: 14 pid: 8190 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.241850:0:11156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc500) 00010000:00010000:1.0:1787733968.241856:0:11156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.241865:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.241872:0:11156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.241895:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733968.241941:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:2355:x1874574690002432:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 160us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733968.241956:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00010000:00010000:0.0:1787733968.242105:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733968.242113:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787733968.242333:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787733968.242474:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787733968.242530:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787733968.242612:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705751936:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787733968.242666:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733968.242687:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a94cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787733968.242817:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705751936 00000100:00100000:1.0:1787733968.242823:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705751936 00000100:00100000:1.0:1787733968.242852:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787733968.242859:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874574705751936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787733968.242930:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874574705751936:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733968.242936:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787733968.242964:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787733968.242970:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891efe90c700, transno 4294967303 00000100:00100000:1.0:1787733968.242981:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705751936:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787733968.243405:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787733968.243452:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705752064:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787733968.243477:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733968.243495:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787733968.243659:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705752064 00000100:00100000:1.0:1787733968.243664:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705752064 00000100:00100000:1.0:1787733968.243679:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787733968.243685:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874574705752064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787733968.243823:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874574705752064:12345-0@lo:1000:mdt00_001.0 Request processed in 137us (344us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787733968.243830:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787733968.243858:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705752064:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787733968.243884:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.243902:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.243908:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.243914:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733968.243919:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.243926:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.243940:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ee0dfc500) 00010000:00010000:1.0:1787733968.243944:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787733968.243949:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.243955:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5b75 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244000:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244006:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5aa3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244012:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5aa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244016:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733968.244024:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5aa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244030:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5aa3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244038:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfca00) 00010000:00010000:1.0:1787733968.244040:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787733968.244043:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5aa3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244048:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5aa3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244070:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244083:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df194cf expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244091:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244112:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194cf expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.244124:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194cf expref: 16 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733968.244133:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705752192:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733968.244202:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787733968.247224:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705752192:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733968.247254:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733968.248822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733968.249095:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690002560 00000100:00100000:1.0:1787733968.249106:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690002560 00010000:00010000:1.0:1787733968.249180:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194cf expref: 17 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733968.249217:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:1.0:1787733968.249226:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+17:2355:x1874574690002560:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733968.249241:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733968.249249:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194cf expref: 17 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.249261:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194cf expref: 17 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.249529:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5abf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df194cf expref: 17 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.249545:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfca00) 00010000:00010000:1.0:1787733968.249551:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.249560:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.249567:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733968.249608:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733968.249666:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:2355:x1874574690002560:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 440us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733968.249674:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00010000:00010000:2.0:1787733968.249789:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249805:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249815:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249822:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249828:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249833:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733968.249837:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249844:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249854:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfca00) 00010000:00010000:2.0:1787733968.249856:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733968.249860:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249865:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5b7c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249877:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249883:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5b6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249896:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5b6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249901:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733968.249904:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5b6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249910:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5b6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249917:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfca00) 00010000:00010000:2.0:1787733968.249920:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787733968.249922:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5b6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.249928:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5b6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733968.250127:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:10433:x1874574690002304:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 12318us (12507us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787733968.250137:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000020:00080000:2.0:1787733968.250140:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787733968.250812:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733968.250817:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787733968.250855:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787733968.250861:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787733968.253217:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733968.253308:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690002816 00000100:00100000:3.0:1787733968.253316:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690002816 00000100:00100000:3.0:1787733968.253370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:3.0:1787733968.253380:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:10433:x1874574690002816:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787733968.254081:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787733968.254237:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787733968.254287:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.254306:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.254319:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.254328:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.254335:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.254341:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733968.254364:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787733968.254462:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+17:10433:x1874574690002816:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 1082us (1254us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787733968.254471:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000020:00080000:3.0:1787733968.254477:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787733968.254679:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787733968.254686:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.254694:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ede00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787733968.254707:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.254721:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.254734:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff891ec6634c00) 00010000:00010000:2.0:1787733968.254737:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787733968.254742:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.254748:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5b83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733968.254765:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733968.254768:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733968.254769:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733968.314616:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733968.698450:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705752320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733968.698524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733968.698634:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705752320 00000100:00100000:3.0:1787733968.698659:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705752320 00000100:00100000:3.0:1787733968.698719:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787733968.698730:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef691a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874574705752320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787733968.698769:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787733968.698834:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef691a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874574705752320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733968.698841:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787733968.698897:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705752320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787733969.338360:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787733969.457091:0:12034:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787733969.457102:0:12034:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787733969.457141:0:12034:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787733969.457147:0:12034:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787733969.600448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733969.600524:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690003072 00000100:00100000:0.0:1787733969.600534:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690003072 00000100:00100000:0.0:1787733969.600595:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:0.0:1787733969.600605:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+17:10450:x1874574690003072:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733969.600630:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733969.600651:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19507 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.600934:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d5b91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.600961:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d5b91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.600992:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d5b91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733969.601006:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787733969.601220:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19507 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.601237:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d5b91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19507 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.601247:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:0.0:1787733969.601250:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787733969.601254:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659000, rc 0) 00000100:00100000:0.0:1787733969.601313:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:10450:x1874574690003072:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 708us (872us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787733969.601321:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:3.0:1787733969.605286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733969.605344:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690003200 00000100:00100000:2.0:1787733969.605361:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690003200 00000100:00100000:2.0:1787733969.605436:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:2.0:1787733969.605453:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:10450:x1874574690003200:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1787733969.605538:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.605559:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.605577:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.605614:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.605622:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.605638:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.605957:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.605966:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.605974:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787733969.606013:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606026:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606042:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606049:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606055:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733969.606090:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606112:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606125:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733969.606128:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733969.606140:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606146:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5b9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606178:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606184:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606189:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606194:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733969.606196:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606202:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606208:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ee0dfca00) 00010000:00010000:2.0:1787733969.606211:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733969.606214:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5ba6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606236:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5ba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606260:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606266:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606279:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606285:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733969.606288:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606295:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606309:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ee0dfc800) 00010000:00010000:2.0:1787733969.606312:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733969.606315:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.606321:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5bad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733969.606420:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:10450:x1874574690003200:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 973us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733969.606428:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:0.0:1787733969.663354:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733969.663537:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690003456 00000100:00100000:3.0:1787733969.663548:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690003456 00000100:00100000:3.0:1787733969.663596:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:3.0:1787733969.663604:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef691ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:10453:x1874574690003456:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733969.663620:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733969.663635:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1950e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.663716:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5bbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.663731:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5bbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.663742:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5bbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.663760:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.663767:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.663783:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664047:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664053:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664058:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733969.664064:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787733969.664133:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5bbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664138:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5bbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664143:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5bbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664146:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733969.664150:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5bbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664174:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5bbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664183:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:3.0:1787733969.664185:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733969.664192:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5bbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664196:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5bbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664205:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664209:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664213:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664219:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ede00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733969.664222:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664228:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664236:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec6634600) 00010000:00010000:3.0:1787733969.664238:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733969.664241:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664247:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664286:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1950e expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664307:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1950e expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.664312:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:3.0:1787733969.664313:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787733969.664315:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec000, rc 0) 00000100:00100000:3.0:1787733969.664360:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef691ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:10453:x1874574690003456:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 757us (1014us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787733969.664365:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:0.0:1787733969.674171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733969.674391:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690003584 00000100:00100000:3.0:1787733969.674399:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690003584 00000100:00100000:3.0:1787733969.674453:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:3.0:1787733969.674461:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:10453:x1874574690003584:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:3.0:1787733969.674514:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.674527:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.674535:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.674554:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.674558:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.674575:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.674579:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733969.674582:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.674587:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.674596:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:3.0:1787733969.674599:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787733969.674602:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.674606:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5bd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733969.674663:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:10453:x1874574690003584:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 202us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733969.674670:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:0.0:1787733969.681814:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733969.684310:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690003840 00000100:00100000:0.0:1787733969.684325:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690003840 00000100:00100000:0.0:1787733969.684393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1787733969.684404:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec738ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:10453:x1874574690003840:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787733969.684650:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec738ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:10453:x1874574690003840:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 246us (2845us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787733969.684670:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1787733969.706113:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733969.706362:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690004096 00000100:00100000:0.0:1787733969.706374:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690004096 00000100:00100000:0.0:1787733969.706479:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:0.0:1787733969.706502:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:9975:x1874574690004096:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787733969.706526:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733969.706546:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5bde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19515 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.706665:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.706691:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1950e expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.706700:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.706734:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1950e expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.706748:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1950e expref: 23 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733969.706764:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6918000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705752448:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733969.706861:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec28d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787733969.709131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733969.709435:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6918000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705752448:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733969.709475:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733969.712378:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690004224 00000100:00100000:2.0:1787733969.712393:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690004224 00010000:00010000:2.0:1787733969.712446:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1950e expref: 24 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733969.712550:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:2.0:1787733969.712561:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:2354:x1874574690004224:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733969.712576:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733969.712583:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1950e expref: 24 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.712598:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1950e expref: 24 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.712621:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d5bc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1950e expref: 24 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.712639:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:2.0:1787733969.712655:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.712664:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.712672:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.712709:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733969.712782:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:2354:x1874574690004224:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 222us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733969.712803:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00010000:00010000:0.0:1787733969.713233:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.713242:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733969.713262:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787733969.713424:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5bde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19515 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.713440:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19515 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.713447:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:0.0:1787733969.713450:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787733969.713453:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658600, rc 0) 00000100:00100000:0.0:1787733969.713498:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:9975:x1874574690004096:12345-192.168.201.34@tcp:101:bash.0 Request processed in 7011us (7396us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787733969.713506:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:3.0:1787733969.717075:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733969.717324:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690004480 00000100:00100000:3.0:1787733969.717334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690004480 00000100:00100000:3.0:1787733969.717517:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:3.0:1787733969.717574:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:9975:x1874574690004480:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:3.0:1787733969.717916:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.717942:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.717950:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787733969.717989:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787733969.718006:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bcac529 reply state 00000000b60767d5 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733969.718011:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787733969.718040:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787733969.718134:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:9975:x1874574690004480:12345-192.168.201.34@tcp:36:bash.0 Request processed in 597us (1073us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787733969.718142:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 89 00000020:00080000:3.0:1787733969.718147:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787733969.719966:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.719983:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.719992:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.719999:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ede00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733969.720004:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.720013:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.720028:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:2.0:1787733969.720031:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733969.720036:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.720042:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5bf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733969.720412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733969.720462:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690004608 00000100:00100000:1.0:1787733969.720471:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690004608 00000100:00100000:1.0:1787733969.720522:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:1.0:1787733969.720531:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:9975:x1874574690004608:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787733969.720552:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733969.720567:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5bfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1951c expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.720618:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5bfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1951c expref: 27 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.720631:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5bfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1951c expref: 27 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.720659:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:1.0:1787733969.720662:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787733969.720688:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cdc00, rc 0) 00000100:00100000:1.0:1787733969.720753:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:9975:x1874574690004608:12345-192.168.201.34@tcp:101:bash.0 Request processed in 221us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733969.720760:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:3.0:1787733969.723018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733969.723063:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690004736 00000100:00100000:2.0:1787733969.723073:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690004736 00000100:00100000:2.0:1787733969.723129:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:2.0:1787733969.723139:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:9975:x1874574690004736:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733969.723188:0:6729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733969.723222:0:6729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005153d69d/0x45228d86de4d5c01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19523 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787733969.723252:0:6729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8ea7cf, atime: 0x6a8ea7cd, ctime: 0x6a8ea7cf, blocks: 0xb 00010000:00010000:2.0:1787733969.723284:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1787733969.723289:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733969.723298:0:6729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005153d69d/0x45228d86de4d5c01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19523 expref: 7 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.723318:0:6729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005153d69d/0x45228d86de4d5c01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19523 expref: 7 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.723330:0:6729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030c00, rc 0) 00000100:00100000:2.0:1787733969.723383:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:9975:x1874574690004736:12345-192.168.201.34@tcp:101:bash.0 Request processed in 245us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733969.723390:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1787733969.725046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733969.725093:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690004864 00000100:00100000:2.0:1787733969.725102:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690004864 00002000:00010000:2.0:1787733969.725142:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787733969.725147:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891ef6186d80 with x1874574690004864 ext(0->18446744073709551615) 00002000:00010000:2.0:1787733969.725271:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891ef6186d80. 00000100:00100000:2.0:1787733969.725311:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:2.0:1787733969.725321:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2356:x1874574690004864:12345-192.168.201.34@tcp:10:bash.0 00002000:00010000:2.0:1787733969.725602:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787733969.725606:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787733967 -> 1787733970 00002000:00010000:2.0:1787733969.725608:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787733965 -> 1787733965 00002000:00010000:2.0:1787733969.725623:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787733967 -> 1787733970 00002000:00010000:2.0:1787733969.725625:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787733969.725725:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2356:x1874574690004864:12345-192.168.201.34@tcp:10:bash.0 Request processed in 405us (685us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787733969.725742:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00002000:00010000:2.0:1787733969.725747:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787733969.725749:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891ef6186d80 with x1874574690004864 ext(0->18446744073709551615) 00002000:00010000:2.0:1787733969.725755:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891ef6186d80. 00000100:00100000:3.0:1787733969.787888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733969.788094:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690004992 00000100:00100000:0.0:1787733969.788467:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690004992 00000100:00100000:0.0:1787733969.788545:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:0.0:1787733969.788558:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:10467:x1874574690004992:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1787733969.788633:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.788666:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.788693:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.788710:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.788717:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.788723:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789495:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789509:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789517:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787733969.789621:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789634:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789640:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789658:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789663:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733969.789667:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789686:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789699:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:0.0:1787733969.789703:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733969.789708:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789714:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789729:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789735:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789741:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789746:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733969.789750:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789767:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.789775:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec6771200) 00010000:00010000:0.0:1787733969.789777:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733969.790084:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.790093:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.790885:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.790896:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.790902:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.790908:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733969.790912:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.790919:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.790929:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:0.0:1787733969.791384:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733969.791393:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.791417:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733969.791656:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:10467:x1874574690004992:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 3095us (3774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733969.791667:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:3.0:1787733969.847594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733969.847795:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690005248 00000100:00100000:1.0:1787733969.847806:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690005248 00000100:00100000:1.0:1787733969.847869:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:1.0:1787733969.847881:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:10470:x1874574690005248:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787733969.847903:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733969.850370:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5c1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1952a expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.850459:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.850474:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.850683:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.850702:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.850710:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.850716:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.851088:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5c32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.851115:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.851124:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733969.851883:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787733969.851988:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.851997:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852005:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852011:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cca00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733969.852016:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852024:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852038:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:1.0:1787733969.852041:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733969.852045:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852051:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852069:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852083:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5c2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852090:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852108:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733969.852112:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852118:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5c2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852126:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec28ef800) 00010000:00010000:1.0:1787733969.852128:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733969.852131:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5c2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852937:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.852999:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5c1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1952a expref: 30 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.853013:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1952a expref: 29 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733969.853021:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:1.0:1787733969.853023:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787733969.853034:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc000, rc 0) 00000100:00100000:1.0:1787733969.853118:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:10470:x1874574690005248:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 5239us (5534us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787733969.853127:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:3.0:1787733969.858341:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733969.860469:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690005376 00000100:00100000:2.0:1787733969.860781:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690005376 00000100:00100000:2.0:1787733969.861126:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:2.0:1787733969.861139:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:10470:x1874574690005376:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1787733969.861229:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.861246:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19515 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.861256:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.861309:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19515 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.861324:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19515 expref: 29 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733969.861339:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1874574705752576:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733969.861460:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171600 going to sleep for 11 seconds 00000100:00100000:2.0:1787733969.866027:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1874574705752576:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733969.866061:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733969.866512:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733969.866817:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690005632 00000100:00100000:1.0:1787733969.866825:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690005632 00000100:00100000:1.0:1787733969.866886:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1787733969.866897:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+30:5591:x1874574690005632:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787733969.867375:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+31:5591:x1874574690005632:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 479us (862us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787733969.867384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:3.0:1787733969.869828:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733969.878336:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690005760 00000100:00100000:2.0:1787733969.878352:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690005760 00010000:00010000:2.0:1787733969.878409:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19515 expref: 31 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733969.878448:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1787733969.878457:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+31:2355:x1874574690005760:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733969.878472:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733969.878489:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19515 expref: 31 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.878504:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19515 expref: 31 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.878527:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5be5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19515 expref: 31 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.878547:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:2.0:1787733969.878554:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.878563:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.878590:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733969.878633:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733969.879054:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+30:2355:x1874574690005760:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 595us (9232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733969.879063:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00010000:00010000:3.0:1787733969.879139:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.879148:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.879221:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.879228:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.879236:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.879242:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733969.879248:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.879254:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.879265:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:3.0:1787733969.879279:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787733969.879284:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733969.879290:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5c40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733969.879336:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:10470:x1874574690005376:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 18199us (21005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733969.879344:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:3.0:1787733969.885843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733969.886067:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690006016 00000100:00100000:2.0:1787733969.886078:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690006016 00000100:00100000:2.0:1787733969.886134:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1787733969.886145:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:10470:x1874574690006016:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733969.887015:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+30:10470:x1874574690006016:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 867us (1179us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787733969.887027:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:3.0:1787733969.980725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733969.980810:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690006272 00000100:00100000:0.0:1787733969.980822:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690006272 00000100:00100000:0.0:1787733969.980888:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:0.0:1787733969.980909:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+30:10481:x1874574690006272:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1787733969.980933:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733969.980955:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19531 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981028:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981042:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981054:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981069:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981077:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981102:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981463:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5c5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981472:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981480:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733969.981490:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787733969.981581:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981589:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981596:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981602:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733969.981606:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981613:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981625:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:0.0:1787733969.981629:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733969.981640:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981646:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981659:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981664:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981680:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981685:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733969.981688:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981694:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981703:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec6771200) 00010000:00010000:0.0:1787733969.981705:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733969.981708:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981714:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981757:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5c47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19531 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981785:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5c5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19531 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733969.981791:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:0.0:1787733969.981794:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733969.981797:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658400, rc 0) 00000100:00100000:0.0:1787733969.981855:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:10481:x1874574690006272:12345-192.168.201.34@tcp:101:cat.0 Request processed in 949us (1141us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787733969.981863:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:3.0:1787733969.988057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733969.998719:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690006528 00000100:00100000:0.0:1787733969.998743:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690006528 00000100:00100000:0.0:1787733969.998857:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:0.0:1787733969.998875:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:10481:x1874574690006528:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:0.0:1787733969.999477:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+33:10481:x1874574690006528:12345-192.168.201.34@tcp:35:cat.0 Request processed in 605us (11444us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787733969.999569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1787733970.021437:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733970.021491:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690006784 00000100:00100000:0.0:1787733970.021502:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690006784 00000100:00100000:0.0:1787733970.021600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:0.0:1787733970.021612:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+33:10482:x1874574690006784:12345-192.168.201.34@tcp:36:rm.0 00000100:00080000:1.0:1787733970.021621:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787733970.021694:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787733970.021732:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5c5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19531 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.021763:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5c32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1952a expref: 32 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.021812:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5bfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1951c expref: 31 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.021825:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec6634300) 00010000:00010000:0.0:1787733970.021839:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787733970.021877:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.021903:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.021915:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.022717:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.022728:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.022737:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.024041:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.024061:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.024074:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787733970.027587:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1787733970.027604:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 288016447685ns, next at 289016443539ns, rc = 0 00010000:00010000:1.0:1787733970.028448:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028469:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028481:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028503:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028511:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028517:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028546:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787733970.028569:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028576:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c78 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028582:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028588:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cca00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.028592:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028599:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c78 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028610:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec28ef800) 00010000:00010000:1.0:1787733970.028613:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787733970.028618:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c78 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.028634:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c78 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.029391:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787733970.029401:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.029408:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cce00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787733970.029412:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.029418:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.029507:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff891ec28ef800) 00010000:00010000:2.0:1787733970.029510:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787733970.029514:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.029530:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5c7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.029549:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733970.029551:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733970.029552:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733970.030405:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.030416:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.030422:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.030427:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.030430:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.030437:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.030448:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:1.0:1787733970.030451:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.030454:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.030460:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5c6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733970.030470:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c85df64b reply state 00000000fbc358b4 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.030479:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787733970.030591:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:10482:x1874574690006784:12345-192.168.201.34@tcp:36:rm.0 Request processed in 8978us (9164us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787733970.030600:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 95 00010000:00010000:1.0:1787733970.035417:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.035435:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.035442:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.035448:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.035454:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.035483:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.035501:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec6771200) 00010000:00010000:1.0:1787733970.035505:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.035509:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.035516:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5c71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733970.088047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733970.088149:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690007040 00000100:00100000:0.0:1787733970.088225:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690007040 00000100:00100000:0.0:1787733970.088578:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:0.0:1787733970.088591:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+31:10488:x1874574690007040:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787733970.088623:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733970.088699:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5c86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19538 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.088871:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.088900:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.088913:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.088931:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.088938:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.088945:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787733970.089560:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787733970.089744:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089754:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089762:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089798:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089806:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089813:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089826:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cca00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.089831:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089838:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089850:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:1.0:1787733970.089854:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.089859:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089866:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5c8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733970.089885:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076ccb8db reply state 000000003a0b69f4 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.089894:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787733970.089927:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5c86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19538 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089944:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19538 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.089951:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef600) 00010000:00010000:1.0:1787733970.089952:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787733970.089955:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cd000, rc 0) 00000100:00100000:1.0:1787733970.090037:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:10488:x1874574690007040:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1449us (2001us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787733970.090052:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00010000:00010000:2.0:1787733970.094350:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.094370:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.094378:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.094384:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733970.094390:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.094396:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.094414:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec28ef800) 00010000:00010000:2.0:1787733970.094418:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733970.094422:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.094428:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5c94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733970.099075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733970.107366:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690007168 00000100:00100000:2.0:1787733970.107400:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690007168 00000100:00100000:2.0:1787733970.107556:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:2.0:1787733970.107568:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2357:x1874574690007168:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733970.107587:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733970.107608:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5ca9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1953f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787733970.107637:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787733970.107657:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1787733970.107662:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733970.107687:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5ca9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1953f expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.107707:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5ca9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1953f expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.107729:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:2.0:1787733970.107799:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2357:x1874574690007168:12345-192.168.201.34@tcp:101:bash.0 Request processed in 233us (8734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.107805:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00080000:1.0:1787733970.112799:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787733970.124077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733970.124218:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690007296 00000100:00100000:2.0:1787733970.124240:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690007296 00000100:00100000:2.0:1787733970.124336:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:2.0:1787733970.124348:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:10488:x1874574690007296:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733970.124368:0:6729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733970.124386:0:6729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19546 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.124424:0:6729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5ca9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1953f expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.124434:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733970.124439:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733970.124445:0:6729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 9 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.124487:0:6729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5ca9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1953f expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.124501:0:6729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5ca9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1953f expref: 9 pid: 6681 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733970.124515:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6729:1874574705752704:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733970.124608:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171600 going to sleep for 11 seconds 00000100:00100000:0.0:1787733970.137014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.137113:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690007424 00000100:00100000:1.0:1787733970.137122:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690007424 00010000:00010000:1.0:1787733970.137198:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5ca9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1953f expref: 10 pid: 6681 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.137243:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1787733970.137253:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:2354:x1874574690007424:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733970.137269:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733970.137294:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5ca9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1953f expref: 10 pid: 6681 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.137310:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5ca9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1953f expref: 10 pid: 6681 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.137335:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733970.137340:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733970.137349:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 10 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.137359:0:7616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 10 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.137397:0:7616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 10 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.137428:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7616:1874574705752832:192.168.201.34@tcp:105: 00000100:00100000:1.0:1787733970.137498:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38240 going to sleep for 11 seconds 00010000:00010000:2.0:1787733970.137660:0:6729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5ca9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1953f expref: 10 pid: 6681 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733970.137685:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6729:1874574705752704:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733970.137712:0:6729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 9 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.137731:0:6729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031000, rc 0) 00000100:00100000:2.0:1787733970.137768:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:10488:x1874574690007296:12345-192.168.201.34@tcp:101:bash.0 Request processed in 13422us (13700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.137776:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:1.0:1787733970.140679:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7616:1874574705752832:192.168.201.34@tcp:105: 00010000:00010000:1.0:1787733970.140706:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733970.141079:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2354:x1874574690007424:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 3825us (4074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733970.141091:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1787733970.143928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.146884:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690007680 00000100:00100000:1.0:1787733970.146901:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690007680 00000100:00100000:1.0:1787733970.146984:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:1.0:1787733970.146996:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+33:10488:x1874574690007680:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1787733970.147361:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:10488:x1874574690007680:12345-192.168.201.34@tcp:35:bash.0 Request processed in 366us (3440us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787733970.147370:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000040:00080000:0.0:1787733970.299607:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787733970.299617:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787733970.299652:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787733970.299658:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1787733970.304594:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:1.0:1787733970.304612:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1787733970.304618:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1787733970.362388:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733970.379011:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733970.379210:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690007808 00000100:00100000:2.0:1787733970.379219:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690007808 00000100:00100000:2.0:1787733970.379267:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:2.0:1787733970.379274:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:10504:x1874574690007808:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733970.379296:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733970.379313:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5cb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1954d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.379367:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5cbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.379380:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.379388:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733970.380087:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787733970.380092:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733970.380118:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.380141:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5cb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1954d expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.380376:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1954d expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.380400:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733970.380402:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787733970.380405:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030800, rc 0) 00000100:00100000:2.0:1787733970.380465:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:10504:x1874574690007808:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1191us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.380476:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:3.0:1787733970.383320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.383396:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690008064 00000100:00100000:1.0:1787733970.383404:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690008064 00000100:00100000:1.0:1787733970.383455:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:1.0:1787733970.383461:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:10504:x1874574690008064:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787733970.383484:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733970.383504:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5cc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19554 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.383616:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5ccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.383626:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.383635:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733970.383643:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787733970.383791:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5cc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19554 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.383813:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19554 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.383821:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef600) 00010000:00010000:1.0:1787733970.383824:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787733970.383828:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc400, rc 0) 00000100:00100000:1.0:1787733970.383885:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+37:10504:x1874574690008064:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 424us (573us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787733970.383890:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:3.0:1787733970.387258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.387676:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690008320 00000100:00100000:1.0:1787733970.387688:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690008320 00000100:00100000:1.0:1787733970.387759:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:1.0:1787733970.387768:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+37:10504:x1874574690008320:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787733970.387788:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733970.387825:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5cda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1955b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.387908:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5ce1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.387920:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.387933:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733970.387946:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787733970.388081:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5cda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1955b expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.388110:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1955b expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.388116:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef600) 00010000:00010000:1.0:1787733970.388118:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787733970.388120:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc600, rc 0) 00000100:00100000:1.0:1787733970.388194:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+39:10504:x1874574690008320:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 427us (943us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787733970.388199:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:3.0:1787733970.388686:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.389800:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690008448 00000100:00100000:1.0:1787733970.389808:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690008448 00000100:00100000:1.0:1787733970.389858:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1787733970.389864:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+39:2357:x1874574690008448:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733970.389885:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733970.389902:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5ccc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19554 expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.389918:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef600) 00010000:00010000:1.0:1787733970.389923:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733970.389970:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:2357:x1874574690008448:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 105us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733970.389977:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1787733970.393868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733970.393961:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690008576 00000100:00100000:2.0:1787733970.393970:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690008576 00000100:00100000:2.0:1787733970.394025:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:2.0:1787733970.394043:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef63f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574690008576:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:2.0:1787733970.394099:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.394115:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 6 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.394122:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733970.394125:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733970.394128:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.394186:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 6 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.394197:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 6 pid: 6729 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733970.394220:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874574705752960:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733970.394286:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b04000 going to sleep for 11 seconds 00000100:00100000:2.0:1787733970.396470:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874574705752960:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733970.396497:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733970.396831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.397278:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690008704 00000100:00100000:1.0:1787733970.397286:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690008704 00002000:00100000:1.0:1787733970.397337:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff891eefd87480 x1874574690008704/t0(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:436/0 lens 504/0 e 0 to 0 dl 1787733981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787733970.397349:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891eefd87480 with x1874574690008704 ext(0->8) 00010000:00010000:1.0:1787733970.397358:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 7 pid: 6729 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.397372:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 7 pid: 6729 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787733970.397381:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff891eefd87480 00000100:00100000:1.0:1787733970.397415:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1787733970.397425:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690008704:12345-192.168.201.34@tcp:4:lfs.0 00000100:00100000:1.0:1787733970.398833:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2354:x1874574690008704:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 1405us (1997us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787733970.398855:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00002000:00100000:1.0:1787733970.398864:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff891eefd87480 x1874574690008704/t4294967302(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:436/0 lens 504/448 e 0 to 0 dl 1787733981 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787733970.398871:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891eefd87480 with x1874574690008704 ext(0->8) 00010000:00010000:1.0:1787733970.398878:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 9 pid: 6729 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.398889:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 9 pid: 6729 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787733970.398894:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff891eefd87480 00000100:00100000:3.0:1787733970.401881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733970.402040:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690008832 00000100:00100000:2.0:1787733970.402050:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690008832 00010000:00010000:2.0:1787733970.402090:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 9 pid: 6729 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733970.402131:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:2.0:1787733970.402140:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2354:x1874574690008832:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733970.402816:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787733970.402834:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787733970.402837:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787733970 00002000:00010000:2.0:1787733970.402838:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787733971 00002000:00010000:2.0:1787733970.402840:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787733970 00010000:00010000:2.0:1787733970.402845:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 9 pid: 6729 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.402856:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 9 pid: 6729 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.402891:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5cb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19546 expref: 9 pid: 6729 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.402903:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733970.402906:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733970.402911:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.402920:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.402987:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733970.403046:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2354:x1874574690008832:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 906us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.403054:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00010000:00010000:0.0:1787733970.403647:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.403658:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.403694:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.403701:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.403707:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.403722:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787733970.403727:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.403737:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.403761:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.403766:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5cef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733970.403841:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef63f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690008576:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 9808us (9980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733970.403846:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:3.0:1787733970.405594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.405847:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690009088 00000100:00100000:1.0:1787733970.405856:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690009088 00000100:00100000:1.0:1787733970.405908:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:1.0:1787733970.405917:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec738d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:10504:x1874574690009088:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:1.0:1787733970.405977:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1955b expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787733970.406703:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787733970.406834:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787733970.409917:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787733970.410022:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.410056:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19538 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.410386:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.410429:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19538 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.410616:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19538 expref: 42 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.410631:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1874574705753088:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733970.410845:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733970.421253:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733970.421462:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690009216 00000100:00100000:2.0:1787733970.421471:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690009216 00010000:00010000:2.0:1787733970.421514:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19538 expref: 43 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733970.421559:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1787733970.421569:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+43:2354:x1874574690009216:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733970.421584:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733970.421591:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19538 expref: 43 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.421623:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19538 expref: 43 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.421644:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef600) 00010000:00010000:2.0:1787733970.421649:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.421658:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.421675:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.421696:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733970.421767:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+43:2354:x1874574690009216:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 199us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.421774:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00010000:00010000:1.0:1787733970.423015:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5c9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19538 expref: 42 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.423226:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1874574705753088:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733970.423251:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.423261:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.423266:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787733970.423398:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787733970.423630:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787733970.423769:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705753216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787733970.423842:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733970.423884:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38480 going to sleep for 11 seconds 00000100:00100000:2.0:1787733970.424368:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705753216 00000100:00100000:2.0:1787733970.424376:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705753216 00000100:00100000:2.0:1787733970.424450:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787733970.424460:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1874574705753216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1787733970.424636:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787733970.424804:0:5835:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787733970.424809:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787733970.424826:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891efe54dc00, transno 4294967301 00000100:00100000:1.0:1787733970.424846:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705753216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787733970.425357:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787733970.425424:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705753344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787733970.425987:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733970.426021:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733970.426554:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787733970.426564:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787733970.427289:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705753344 00000100:00100000:3.0:1787733970.427297:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705753344 00000100:00100000:0.0:1787733970.427506:0:12051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787733970.427518:0:12051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5835:x1874574705753344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787733970.427775:0:12051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5835:x1874574705753344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 260us (1788us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787733970.427783:0:12051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787733970.427988:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705753344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787733970.428061:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787733970.428110:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.428120:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.428129:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.428135:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.428139:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.428147:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.428201:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef600) 00010000:00010000:1.0:1787733970.428204:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787733970.428209:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.428215:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5cf6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787733970.428374:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787733970.428456:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787733970.428466:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288417309319ns, next at 289417307269ns, rc = 0 00000001:00080000:1.0:1787733970.428482:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787733970.428511:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef600) 00010000:00010000:1.0:1787733970.428514:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787733970.428521:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5ce1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1955b expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.428614:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec738d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+45:10504:x1874574690009088:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 22698us (23026us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787733970.428621:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000020:00080000:1.0:1787733970.428625:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787733970.429324:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874574705753216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 4863us (5479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.429333:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787733970.439493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.440034:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690009344 00000100:00100000:1.0:1787733970.440051:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690009344 00000100:00100000:1.0:1787733970.440131:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:1.0:1787733970.440144:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+45:10504:x1874574690009344:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787733970.440198:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733970.440223:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5cfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19562 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.440306:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5cfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19562 expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.440324:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5cfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19562 expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.440344:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733970.440347:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787733970.440351:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cd000, rc 0) 00000100:00100000:1.0:1787733970.440423:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:10504:x1874574690009344:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 282us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733970.440430:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:3.0:1787733970.450658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733970.450904:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690009600 00000100:00100000:2.0:1787733970.450914:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690009600 00000100:00100000:2.0:1787733970.450971:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:2.0:1787733970.450984:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:10504:x1874574690009600:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733970.451453:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:10504:x1874574690009600:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 471us (803us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787733970.451462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:0.0:1787733970.550381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.550875:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690009728 00000100:00100000:1.0:1787733970.550893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690009728 00000100:00100000:1.0:1787733970.550975:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:1.0:1787733970.550986:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:10514:x1874574690009728:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:1.0:1787733970.551074:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551092:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551104:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551122:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551149:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551195:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551301:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551310:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551318:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733970.551366:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551381:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551387:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551394:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551400:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.551404:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551412:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551433:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:1.0:1787733970.551436:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.551441:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551447:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551465:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551470:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551476:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551481:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.551484:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551490:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551498:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec28ef600) 00010000:00010000:1.0:1787733970.551500:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.551503:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551509:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551534:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551541:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551546:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551551:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60ccc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.551554:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551559:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551567:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733970.551570:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.551572:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.551578:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.551678:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:10514:x1874574690009728:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 693us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733970.551686:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:3.0:1787733970.583098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.583251:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690009984 00000100:00100000:1.0:1787733970.583271:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690009984 00000100:00100000:1.0:1787733970.583329:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:1.0:1787733970.583360:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:10517:x1874574690009984:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787733970.583386:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733970.583407:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19569 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583491:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583505:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583516:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583531:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583539:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583545:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583703:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583713:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583721:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733970.583765:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787733970.583867:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583875:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583881:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583886:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.583891:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583898:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583909:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:1.0:1787733970.583912:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.583917:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583923:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583940:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583946:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583963:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583968:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.583971:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583977:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583985:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec28ef600) 00010000:00010000:1.0:1787733970.583988:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.583991:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.583996:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.584037:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19569 expref: 50 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.584052:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19569 expref: 49 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.584060:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733970.584062:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787733970.584065:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cca00, rc 0) 00000100:00100000:1.0:1787733970.584576:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+49:10517:x1874574690009984:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1217us (1497us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787733970.584596:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:3.0:1787733970.598872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.599007:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690010112 00000100:00100000:1.0:1787733970.599020:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690010112 00000100:00100000:1.0:1787733970.599103:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:1.0:1787733970.599115:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+49:10517:x1874574690010112:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:1.0:1787733970.599236:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.599256:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.599269:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.599300:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.599308:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.599317:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.599322:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60ccc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.599328:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.599336:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.599349:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733970.599369:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787733970.599375:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.599381:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.599507:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+49:10517:x1874574690010112:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 393us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733970.599515:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:2.0:1787733970.607216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.607609:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690010368 00000100:00100000:1.0:1787733970.607623:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690010368 00000100:00100000:1.0:1787733970.607718:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:1.0:1787733970.607732:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+49:10517:x1874574690010368:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1787733970.608078:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:10517:x1874574690010368:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 348us (875us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787733970.608097:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:3.0:1787733970.704798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733970.705197:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690010624 00000100:00100000:0.0:1787733970.705210:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690010624 00000100:00100000:0.0:1787733970.705435:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:0.0:1787733970.705449:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:10527:x1874574690010624:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787733970.705498:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733970.705503:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787733970.705537:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5cbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1954d expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.705562:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:0.0:1787733970.705585:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787733970.705605:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5d43 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19570 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.705778:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.705796:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19569 expref: 50 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.705808:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.705863:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19569 expref: 50 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.705880:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19569 expref: 50 pid: 8190 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733970.705896:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6919880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705753472:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733970.706019:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec28d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787733970.711316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733970.711462:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6919880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705753472:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733970.711511:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733970.711890:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690010752 00000100:00100000:2.0:1787733970.711899:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690010752 00010000:00010000:2.0:1787733970.711951:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19569 expref: 51 pid: 8190 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733970.711998:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1787733970.712009:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+51:2354:x1874574690010752:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733970.712029:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733970.712037:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19569 expref: 51 pid: 8190 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.712052:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19569 expref: 51 pid: 8190 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.712080:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d5d2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19569 expref: 51 pid: 8190 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.712107:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:2.0:1787733970.712113:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.712123:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.712149:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.712218:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733970.712289:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:2354:x1874574690010752:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 281us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.712297:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00010000:00010000:0.0:1787733970.712582:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.712592:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733970.712643:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787733970.712859:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5d43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19570 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.712882:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19570 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733970.712890:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:0.0:1787733970.712893:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787733970.712896:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658400, rc 0) 00000100:00100000:0.0:1787733970.712927:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:10527:x1874574690010624:12345-192.168.201.34@tcp:101:bash.0 Request processed in 7482us (8147us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787733970.712935:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:2.0:1787733970.720449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.720559:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690011008 00000100:00100000:1.0:1787733970.720572:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690011008 00000100:00100000:1.0:1787733970.720646:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 105 00000100:00100000:1.0:1787733970.720667:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:10527:x1874574690011008:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:1.0:1787733970.721005:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.721026:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.721040:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787733970.721118:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787733970.721140:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a48ba27a reply state 000000007fd5902b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.721151:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787733970.721700:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10527:x1874574690011008:12345-192.168.201.34@tcp:36:bash.0 Request processed in 1041us (1262us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787733970.721708:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 105 00000020:00080000:1.0:1787733970.721714:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787733970.729618:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.729652:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.729670:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.729677:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60ccc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.729683:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.729692:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.729716:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733970.729720:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.729727:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.729734:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733970.730269:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.730614:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690011136 00000100:00100000:1.0:1787733970.730627:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690011136 00000100:00100000:1.0:1787733970.730709:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:1.0:1787733970.730721:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10527:x1874574690011136:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787733970.730751:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733970.730772:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19577 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.731004:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.731021:0:8190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19570 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.731031:0:8190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.731071:0:8190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19570 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.731087:0:8190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19570 expref: 53 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.731103:0:8190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705753600:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733970.731347:0:8190:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38900 going to sleep for 11 seconds 00000100:00100000:2.0:1787733970.737548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733970.738195:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690011264 00000100:00100000:3.0:1787733970.738208:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690011264 00010000:00010000:3.0:1787733970.738269:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19570 expref: 54 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733970.738315:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:3.0:1787733970.738344:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:2355:x1874574690011264:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733970.738363:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733970.738371:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19570 expref: 54 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733970.738387:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19570 expref: 54 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733970.738414:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:3.0:1787733970.738420:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733970.738431:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733970.738440:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733970.738462:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733970.738550:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:2355:x1874574690011264:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 208us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733970.738559:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00010000:00010000:1.0:1787733970.741203:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d5d4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19570 expref: 53 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.741739:0:8190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705753600:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733970.741772:0:8190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.741786:0:8190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.741792:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733970.742606:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787733970.742616:0:8190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787733970.742667:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.742715:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19577 expref: 53 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.742738:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19577 expref: 52 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.742748:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733970.742751:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787733970.742755:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc400, rc 0) 00000100:00100000:1.0:1787733970.742861:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10527:x1874574690011136:12345-192.168.201.34@tcp:101:bash.0 Request processed in 12142us (12599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733970.742872:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:2.0:1787733970.753240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.755802:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690011520 00000100:00100000:1.0:1787733970.755821:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690011520 00000100:00100000:2.0:1787733970.761130:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1787733970.761149:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:10527:x1874574690011520:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1787733970.761471:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10527:x1874574690011520:12345-192.168.201.34@tcp:35:bash.0 Request processed in 325us (8243us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787733970.761479:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:3.0:1787733970.842294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733970.843375:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690011648 00000100:00100000:2.0:1787733970.843390:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690011648 00000100:00100000:2.0:1787733970.843479:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:2.0:1787733970.843494:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:10533:x1874574690011648:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733970.843525:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733970.843554:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5d6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1957e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.843643:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5d74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.843693:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.843707:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733970.843781:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787733970.843784:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733970.843809:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.843839:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5d6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1957e expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.844362:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1957e expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.844376:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733970.844380:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787733970.844384:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030a00, rc 0) 00000100:00100000:2.0:1787733970.845444:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10533:x1874574690011648:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1948us (3160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.845747:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:0.0:1787733970.847680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.847777:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690011776 00000100:00100000:1.0:1787733970.847788:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690011776 00000100:00100000:1.0:1787733970.847859:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:1.0:1787733970.847871:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10533:x1874574690011776:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787733970.847896:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733970.847921:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19585 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.847997:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848013:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848026:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848043:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848050:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848058:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848208:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5d90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848218:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848242:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733970.848286:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787733970.848291:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787733970.848312:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848327:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848335:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848343:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848349:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848357:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60ccc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.848362:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848371:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848385:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:1.0:1787733970.848388:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.848394:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848412:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5d82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848445:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848452:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5d89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848458:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848464:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cdc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733970.848466:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848472:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5d89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848480:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec28ef600) 00010000:00010000:1.0:1787733970.848483:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733970.848486:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5d89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848491:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5d89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848529:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5d7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19585 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848544:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19585 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.848559:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733970.848562:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787733970.848564:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc000, rc 0) 00000100:00100000:1.0:1787733970.848639:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:10533:x1874574690011776:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 770us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733970.848648:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:0.0:1787733970.854665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733970.854719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.854847:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690012032 00000100:00100000:1.0:1787733970.854860:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690012032 00000100:00100000:1.0:1787733970.854931:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:1.0:1787733970.854943:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:10533:x1874574690012032:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787733970.854972:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733970.854997:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5d97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1958c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733970.855010:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690012160 00000100:00100000:3.0:1787733970.855016:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690012160 00000100:00100000:3.0:1787733970.855059:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787733970.855068:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:2354:x1874574690012160:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733970.855093:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733970.855125:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d5d90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19585 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733970.855146:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:3.0:1787733970.855150:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733970.855176:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.855193:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19577 expref: 56 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.855203:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.855244:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19577 expref: 56 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.855260:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19577 expref: 56 pid: 8190 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733970.855283:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705753728:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733970.855399:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38900 going to sleep for 11 seconds 00000100:00100000:3.0:1787733970.855925:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:2354:x1874574690012160:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 851us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733970.855935:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1787733970.864206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.864383:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705753728:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733970.864419:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733970.864496:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690012288 00000100:00100000:3.0:1787733970.864509:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690012288 00010000:00010000:2.0:1787733970.864726:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19577 expref: 56 pid: 8190 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733970.864777:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:2.0:1787733970.864790:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:2355:x1874574690012288:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733970.864830:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733970.864839:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19577 expref: 56 pid: 8190 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.864934:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19577 expref: 56 pid: 8190 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.864964:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d5d66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19577 expref: 56 pid: 8190 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.864989:0:11156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:2.0:1787733970.864995:0:11156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.865007:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.865015:0:11156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.865045:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733970.865076:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.865086:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733970.865110:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:2.0:1787733970.865196:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:2355:x1874574690012288:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 408us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.865207:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00010000:00010000:1.0:1787733970.865435:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5d97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1958c expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.865456:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1958c expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.865466:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733970.865469:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787733970.865472:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc200, rc 0) 00000100:00100000:1.0:1787733970.865501:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:10533:x1874574690012032:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 10561us (10782us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787733970.865509:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:0.0:1787733970.874871:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733970.875003:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690012544 00000100:00100000:2.0:1787733970.875018:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690012544 00000100:00100000:2.0:1787733970.875114:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1787733970.875129:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:10533:x1874574690012544:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:2.0:1787733970.875203:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733970.875232:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5cfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19562 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.875268:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:2.0:1787733970.875275:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733970.875347:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10533:x1874574690012544:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 222us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.875353:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1787733970.878928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733970.879020:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690012672 00000100:00100000:1.0:1787733970.879049:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690012672 00000100:00100000:1.0:1787733970.879221:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:1.0:1787733970.879235:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef691a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10533:x1874574690012672:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:1.0:1787733970.879397:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.879419:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733970.879434:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787733970.879879:0:8190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787733970.880009:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef691a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10533:x1874574690012672:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 775us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733970.880019:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:1.0:1787733970.883507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733970.883635:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690012800 00000100:00100000:2.0:1787733970.883650:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690012800 00000100:00100000:2.0:1787733970.883744:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:2.0:1787733970.883756:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:10533:x1874574690012800:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733970.883784:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733970.883811:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5db3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19593 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.883892:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.883906:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5db3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19593 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.883931:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.883947:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5db3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19593 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.883992:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:2.0:1787733970.883996:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787733970.884001:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5db3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19593 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733970.884008:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030800, rc 0) 00000100:00100000:2.0:1787733970.884089:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:10533:x1874574690012800:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 335us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733970.884098:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 111 00000040:00080000:0.0:1787733971.322785:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787733971.322796:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787733971.322834:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787733971.322841:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787733971.323007:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6919180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705753856:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787733971.323179:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec28d3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787733971.330876:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6919180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705753856:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787733971.334711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.335284:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690012928 00000100:00100000:1.0:1787733971.335298:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690012928 00000100:00100000:1.0:1787733971.335719:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:1.0:1787733971.335734:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:10535:x1874574690012928:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787733971.335777:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787733971.336714:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:10535:x1874574690012928:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 195us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733971.336727:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:1.0:1787733971.341730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733971.341848:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690013056 00000100:00100000:3.0:1787733971.341864:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690013056 00000100:00100000:3.0:1787733971.341940:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:3.0:1787733971.341952:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:10535:x1874574690013056:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787733971.342051:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5dba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.342072:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5dba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.342103:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5dba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343512:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5dc1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343532:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343542:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343582:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343588:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343592:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733971.343631:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787733971.343635:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787733971.343660:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343673:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5dba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343679:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5dba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343686:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5dba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343692:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733971.343696:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5dba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343704:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5dba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343715:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:3.0:1787733971.343724:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733971.343730:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5dba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343737:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5dba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343755:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343761:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5dc1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343768:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343773:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733971.343777:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343783:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5dc1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343790:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff891ec6634e00) 00010000:00010000:3.0:1787733971.343791:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733971.343793:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5dc1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343797:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5dc1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.343810:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.344083:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.344088:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.344091:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ed600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733971.344093:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.344097:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.344103:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:3.0:1787733971.344104:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733971.344107:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.344110:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5dc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733971.344233:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:10535:x1874574690013056:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 2279us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733971.344244:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:2.0:1787733971.352717:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.355247:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690013312 00000100:00100000:1.0:1787733971.355272:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690013312 00000100:00100000:1.0:1787733971.355452:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:1.0:1787733971.355496:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:10535:x1874574690013312:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787733971.355525:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733971.355552:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5dcf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1959a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.355695:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5dd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.355714:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.355728:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733971.355742:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787733971.355866:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.355874:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5dd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.355882:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.355902:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60ccc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733971.355908:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.355917:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.355932:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733971.355942:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787733971.355948:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5dd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.355956:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5dd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.356016:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5dcf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1959a expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.356028:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:1.0:1787733971.356031:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787733971.356035:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5dcf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1959a expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.356048:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cdc00, rc 0) 00000100:00100000:1.0:1787733971.356211:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:10535:x1874574690013312:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 719us (3510us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787733971.356220:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:0.0:1787733971.361756:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733971.362124:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690013440 00000100:00100000:2.0:1787733971.362138:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690013440 00000100:00100000:2.0:1787733971.362241:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:2.0:1787733971.362254:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:10535:x1874574690013440:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787733971.362311:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787733971.362452:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:10535:x1874574690013440:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 200us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733971.362469:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:2.0:1787733971.366360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733971.366731:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690013696 00000100:00100000:3.0:1787733971.366743:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690013696 00000100:00100000:3.0:1787733971.366812:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:3.0:1787733971.366825:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:10535:x1874574690013696:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733971.366850:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733971.366862:0:8190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787733971.366964:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5d74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1957e expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.366990:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:3.0:1787733971.366996:0:8190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733971.367015:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5de4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195a1 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787733971.368022:0:8190:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787733971.368670:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5deb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.368689:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.368702:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.368771:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5de4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a1 expref: 58 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.368791:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a1 expref: 57 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.368800:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ec6634e00) 00010000:00010000:3.0:1787733971.368804:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787733971.368808:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec200, rc 0) 00000100:00100000:3.0:1787733971.368901:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:10535:x1874574690013696:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2077us (2556us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787733971.368927:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:0.0:1787733971.372695:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733971.372783:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690013952 00000100:00100000:3.0:1787733971.372796:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690013952 00000100:00100000:3.0:1787733971.372865:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:3.0:1787733971.372876:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef691b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:10535:x1874574690013952:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787733971.372962:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733971.372996:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5deb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a1 expref: 57 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.373023:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ec6634e00) 00010000:00010000:3.0:1787733971.373039:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733971.373067:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5df9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.373287:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5df9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.373300:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5df9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375311:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc38938d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375336:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc38938d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375351:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc38938d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375470:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5df9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375479:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5df9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375485:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5df9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375492:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733971.375496:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5df9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375504:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5df9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375517:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:3.0:1787733971.375520:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733971.375525:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5df9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375531:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5df9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375544:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc38938d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375550:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc38938d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375556:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc38938d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375567:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7eda00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733971.375570:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc38938d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375576:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc38938d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375596:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc38938d8 (ffff891ec6634600) 00010000:00010000:3.0:1787733971.375599:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733971.375602:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc38938d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.375608:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc38938d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733971.376277:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef691b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:10535:x1874574690013952:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 3395us (3590us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787733971.376286:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:0.0:1787733971.380297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733971.380656:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690014080 00000100:00100000:2.0:1787733971.380672:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690014080 00000100:00100000:2.0:1787733971.380754:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:2.0:1787733971.380767:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:10535:x1874574690014080:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787733971.380793:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733971.380839:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5e07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195a8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.381000:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.381018:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.381032:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.381616:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5e07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a8 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.381642:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a8 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.381664:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ed3d91a00) 00010000:00010000:2.0:1787733971.381668:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787733971.381672:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030a00, rc 0) 00000100:00100000:2.0:1787733971.381802:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:10535:x1874574690014080:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1037us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733971.381813:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 118 00010000:00010000:3.0:1787733971.386854:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733971.386986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.387067:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690014336 00000100:00100000:1.0:1787733971.387090:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690014336 00000100:00100000:1.0:1787733971.387188:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:1.0:1787733971.387202:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:10535:x1874574690014336:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787733971.387312:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.387334:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.387346:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787733971.387708:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1787733971.387722:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 289376565356ns, next at 290376561541ns, rc = 0 00000004:00010000:1.0:1787733971.387832:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1f1af1f reply state 00000000fcbd4cd5 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733971.387843:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787733971.387967:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:10535:x1874574690014336:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 767us (989us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787733971.387975:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:1.0:1787733971.392624:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733971.392709:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690014464 00000100:00100000:3.0:1787733971.392720:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690014464 00000100:00100000:3.0:1787733971.392804:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:3.0:1787733971.392813:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:10535:x1874574690014464:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733971.392847:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733971.392869:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195af expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.392942:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195af expref: 60 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.392974:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195af expref: 60 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.392993:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ed3d91a00) 00010000:00010000:3.0:1787733971.392996:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787733971.392999:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7eda00, rc 0) 00000100:00100000:3.0:1787733971.393060:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:10535:x1874574690014464:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 248us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733971.393068:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00010000:00010000:2.0:1787733971.393712:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.393724:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.393744:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.393750:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cdc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733971.393756:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.393763:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.393778:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ed3d91a00) 00010000:00010000:2.0:1787733971.393781:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787733971.393785:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.393791:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d5e15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733971.395971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733971.396060:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690014592 00000100:00100000:2.0:1787733971.396131:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690014592 00000100:00100000:2.0:1787733971.396288:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:2.0:1787733971.396301:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2355:x1874574690014592:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787733971.396745:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2355:x1874574690014592:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 447us (784us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787733971.396751:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00080000:1.0:1787733971.397714:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787733971.399025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733971.399081:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690014848 00000100:00100000:2.0:1787733971.399094:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690014848 00000100:00100000:3.0:1787733971.399196:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:3.0:1787733971.399211:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:10535:x1874574690014848:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787733971.399521:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:10535:x1874574690014848:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 314us (502us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787733971.399530:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1787733971.401313:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.401493:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690015104 00000100:00100000:1.0:1787733971.401501:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690015104 00000100:00100000:1.0:1787733971.401572:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:1.0:1787733971.401580:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:10535:x1874574690015104:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787733971.401697:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:10535:x1874574690015104:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 117us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733971.401705:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1787733971.403571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733971.403676:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690015232 00000100:00100000:2.0:1787733971.403704:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690015232 00000100:00100000:2.0:1787733971.403783:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:2.0:1787733971.403791:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef691bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:10535:x1874574690015232:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787733971.403811:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733971.403834:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5e23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195b6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.403917:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5e2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.403931:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.403941:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733971.403982:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733971.404006:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.404035:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195b6 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.404056:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195b6 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.404065:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ed3d91a00) 00010000:00010000:2.0:1787733971.404068:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787733971.404213:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:2.0:1787733971.404290:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef691bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:10535:x1874574690015232:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 487us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733971.404305:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:2.0:1787733971.406841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733971.406971:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690015360 00000100:00100000:3.0:1787733971.406983:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690015360 00000100:00100000:3.0:1787733971.407050:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:3.0:1787733971.407062:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2354:x1874574690015360:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787733971.407310:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733971.407342:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195bd expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787733971.407438:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ea7d4, blocks: 0x1 00010000:00010000:2.0:1787733971.407522:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=289s v=(0 0) 00010000:00010000:2.0:1787733971.407527:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733971.407537:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195bd expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.407556:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195bd expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.407569:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca800, rc 0) 00000100:00100000:2.0:1787733971.407681:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:2354:x1874574690015360:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 619us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733971.407688:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:1.0:1787733971.410118:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733971.410258:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690015616 00000100:00100000:3.0:1787733971.410270:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690015616 00000100:00100000:3.0:1787733971.410332:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:3.0:1787733971.410344:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:10535:x1874574690015616:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787733971.410567:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:10535:x1874574690015616:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 225us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733971.410595:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:0.0:1787733971.413141:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733971.413212:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690015744 00000100:00100000:2.0:1787733971.413224:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690015744 00000100:00100000:2.0:1787733971.413293:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1787733971.413305:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:10535:x1874574690015744:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787733971.413330:0:6729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733971.413357:0:6729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195c4 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.413528:0:6729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195bd expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.413539:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733971.413544:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733971.413550:0:6729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 11 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.413599:0:6729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195bd expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.413615:0:6729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195bd expref: 11 pid: 6682 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733971.413632:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6729:1874574705753984:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733971.413789:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733971.417770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733971.417933:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6729:1874574705753984:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733971.417978:0:6729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 11 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.418006:0:6729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca000, rc 0) 00000100:00100000:0.0:1787733971.418204:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+11:10535:x1874574690015744:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 4899us (5071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733971.418216:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:3.0:1787733971.418594:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690015872 00000100:00100000:3.0:1787733971.418602:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690015872 00010000:00010000:3.0:1787733971.418640:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195bd expref: 11 pid: 6682 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733971.418687:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1787733971.418697:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+11:2355:x1874574690015872:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733971.418719:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733971.418751:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195bd expref: 11 pid: 6682 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.418763:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195bd expref: 11 pid: 6682 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.418787:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195bd expref: 11 pid: 6682 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.418802:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733971.418806:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733971.418813:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 10 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.418821:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 10 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.418872:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 10 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733971.418936:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefd84e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5817:1874574705754112:192.168.201.34@tcp:105: 00000100:00100000:3.0:1787733971.418995:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed1c9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787733971.421890:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefd84e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5817:1874574705754112:192.168.201.34@tcp:105: 00010000:00010000:3.0:1787733971.421925:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733971.421995:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:2355:x1874574690015872:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 3297us (4245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733971.422008:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:1.0:1787733971.424819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733971.424938:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690016000 00000100:00100000:0.0:1787733971.424950:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690016000 00002000:00100000:0.0:1787733971.425010:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff891efef68e00 x1874574690016000/t0(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:437/0 lens 504/0 e 0 to 0 dl 1787733982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787733971.425023:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891efef68e00 with x1874574690016000 ext(0->12) 00002000:00010000:0.0:1787733971.425029:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891efef68e00 00000100:00100000:0.0:1787733971.425107:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:0.0:1787733971.425117:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:2355:x1874574690016000:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787733971.425906:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:2355:x1874574690016000:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 786us (1096us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787733971.425925:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00002000:00100000:0.0:1787733971.425933:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff891efef68e00 x1874574690016000/t4294967308(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:437/0 lens 504/448 e 0 to 0 dl 1787733982 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787733971.425944:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891efef68e00 with x1874574690016000 ext(0->12) 00002000:00010000:0.0:1787733971.425949:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891efef68e00 00000100:00100000:2.0:1787733971.430068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733971.430288:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690016128 00000100:00100000:3.0:1787733971.430300:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690016128 00000100:00100000:2.0:1787733971.430536:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:2.0:1787733971.430547:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:10535:x1874574690016128:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787733971.461963:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:10535:x1874574690016128:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 31177us (31671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733971.461980:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000001:00080000:2.0:1787733971.463042:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000020:00080000:2.0:1787733971.463075:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1787733971.463097:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1787733971.463102:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787733971.463149:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787733971.463187:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff891efec38480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787733971.463192:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891ed11daa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff891efec38a80 00000020:00080000:2.0:1787733971.463195:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891ed11da600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff891ed2045000 00000004:00080000:2.0:1787733971.463221:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787733971.463232:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff891efec38300 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787733971.463236:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891ed11dae00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff891efec38780 00000020:00080000:2.0:1787733971.463239:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891ed11dad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff891ef681a000 00000001:00080000:2.0:1787733971.463260:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:1.0:1787733971.463700:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787733971.463930:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787733971.465685:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705754240:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787733971.465802:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733971.465924:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705754240 00000100:00100000:2.0:1787733971.465934:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705754240 00000100:00100000:2.0:1787733971.466037:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787733971.466050:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705754240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787733971.466089:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787733971.466125:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.466188:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005153d69d/0x45228d86de4d5c01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19523 expref: 11 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.466200:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787733971.466206:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733971.466212:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.466248:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005153d69d/0x45228d86de4d5c01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19523 expref: 11 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.466283:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005153d69d/0x45228d86de4d5c01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19523 expref: 11 pid: 6729 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733971.466300:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe93a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874574705754368:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733971.466593:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b040c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787733971.466694:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787733971.467268:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705754496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787733971.467315:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733971.467363:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705754496 00000100:00100000:1.0:1787733971.467369:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705754496 00000100:00100000:1.0:1787733971.467748:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787733971.467758:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1874574705754496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787733971.467977:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787733971.467981:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787733972 00002000:00010000:1.0:1787733971.467984:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787733971.467987:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787733972 -> 1787733972 00002000:00010000:1.0:1787733971.467989:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787733971.468035:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3311:x1874574705754496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 277us (719us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787733971.468043:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1787733971.468100:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891eefd85f80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787733971.468107:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705754496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787733971.468219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.468336:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690016256 00000100:00100000:1.0:1787733971.468341:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690016256 00000100:00100000:1.0:1787733971.468375:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1787733971.468394:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:2356:x1874574690016256:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787733971.469138:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787733971.469152:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705754624:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787733971.469215:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733971.469299:0:6729:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787733971.469310:0:6729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787733971.469782:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705754624 00000100:00100000:1.0:1787733971.469789:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705754624 00000100:00100000:2.0:1787733971.472319:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787733971.472340:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3313:x1874574705754624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787733971.472390:0:12052:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1787733971.472494:0:12052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8ea7d2, atime: 0x6a8ea7d3, ctime: 0x6a8ea7d2, blocks: 0x1 00010000:00010000:2.0:1787733971.472504:0:12052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d5e46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.472525:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=289s v=(0 0) 00010000:00010000:2.0:1787733971.472531:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733971.472539:0:12052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d5e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.472559:0:12052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d5e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.472571:0:12052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d5e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.472589:0:12052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d5e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.472617:0:12052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787733971.472966:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787733971.472975:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d5e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.472985:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787733971.472991:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d5e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.473001:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d5e46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.473021:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d5e46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.473029:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d5e46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.473047:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733971.473056:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733971.473058:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733971.473374:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705754624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1039us (4156us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787733971.473384:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:0.0:1787733971.473564:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891eef7ab800/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787733971.473570:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705754624:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787733971.482846:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe93a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874574705754368:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733971.482882:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733971.482936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733971.485549:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690016384 00000100:00100000:3.0:1787733971.485567:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690016384 00010000:00010000:3.0:1787733971.485634:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005153d69d/0x45228d86de4d5c01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19523 expref: 13 pid: 6729 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733971.485743:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1787733971.485756:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:2354:x1874574690016384:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733971.485774:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733971.485781:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005153d69d/0x45228d86de4d5c01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19523 expref: 13 pid: 6729 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.485797:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005153d69d/0x45228d86de4d5c01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19523 expref: 13 pid: 6729 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.485839:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005153d69d/0x45228d86de4d5c01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19523 expref: 13 pid: 6729 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.485860:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787733971.485865:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787733971.485871:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.485883:0:11156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.485955:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733971.486043:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:2354:x1874574690016384:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 288us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733971.486063:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00010000:00010000:0.0:1787733971.486417:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.486430:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.486441:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.486450:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.486470:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787733971.487208:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3310:x1874574705754240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21156us (21403us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787733971.487219:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1787733971.487287:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891eefd84e00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787733971.487294:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705754240:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787733971.487770:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787733971.487779:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.487792:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787733971.487798:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.487809:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.487844:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.487853:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8f6c70/0x45228d86de4d5e3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.487876:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733971.487879:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733971.487880:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787733971.505008:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787733971.505033:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1787733971.505219:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2356:x1874574690016256:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 36815us (36990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733971.505247:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:2.0:1787733971.515021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.515254:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690016640 00000100:00100000:1.0:1787733971.515269:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690016640 00000100:00100000:1.0:1787733971.515402:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:1.0:1787733971.515416:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:10535:x1874574690016640:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787733971.515504:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733971.515539:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5e2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195b6 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.515565:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ed3d91a00) 00010000:00010000:1.0:1787733971.515570:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733971.515612:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.515629:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.515639:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733971.515966:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082827dd0 reply state 000000005d64f422 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733971.515978:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787733971.516515:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:10535:x1874574690016640:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1099us (1505us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787733971.516524:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:3.0:1787733971.522428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733971.522959:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690016768 00000100:00100000:0.0:1787733971.522974:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690016768 00000100:00100000:0.0:1787733971.523046:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1787733971.523061:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574690016768:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787733971.523345:0:6729:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787733971.523349:0:6729:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787733972 -> 1787733971 00002000:00010000:0.0:1787733971.523352:0:6729:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787733971 00002000:00010000:0.0:1787733971.523355:0:6729:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787733972 -> 1787733971 00002000:00010000:0.0:1787733971.523357:0:6729:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787733971.523433:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690016768:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 374us (1024us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787733971.523441:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1787733971.526406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733971.526567:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690017024 00000100:00100000:0.0:1787733971.526578:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690017024 00000100:00100000:0.0:1787733971.526654:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:0.0:1787733971.526665:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:10535:x1874574690017024:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787733971.526843:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.526863:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a8 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.526876:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.526938:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a8 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.526954:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a8 expref: 16 pid: 5832 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733971.526971:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef691b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1874574705754752:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733971.527124:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec28d30c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787733971.527284:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.527300:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.527306:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.527312:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733971.527318:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.527325:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.527345:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ed3d91a00) 00010000:00010000:1.0:1787733971.527348:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733971.527353:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.527359:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733971.540888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.540989:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690017152 00000100:00100000:1.0:1787733971.541005:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690017152 00010000:00010000:1.0:1787733971.541094:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a8 expref: 16 pid: 5832 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733971.541152:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1787733971.541212:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:2354:x1874574690017152:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733971.541232:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733971.541263:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a8 expref: 16 pid: 5832 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.541278:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a8 expref: 16 pid: 5832 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.541310:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ed3d91a00) 00010000:00010000:1.0:1787733971.541316:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.541327:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.541335:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.541359:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733971.541451:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:2354:x1874574690017152:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 242us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733971.541459:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00010000:00010000:0.0:1787733971.544630:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195a8 expref: 15 pid: 5832 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733971.544677:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef691b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1874574705754752:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733971.544715:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.544728:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.544734:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.544774:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.544783:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.544791:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.545619:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733971.545626:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.545637:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.545670:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ed3d91a00) 00010000:00010000:0.0:1787733971.545673:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787733971.545678:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.545685:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d5e54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733971.545798:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:10535:x1874574690017024:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 19131us (19404us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787733971.545809:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:2.0:1787733971.552494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.552638:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690017280 00000100:00100000:1.0:1787733971.552660:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690017280 00000100:00100000:1.0:1787733971.552735:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1787733971.552748:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690017280:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787733971.552808:0:12052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.552845:0:12052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 7 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.552881:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733971.552886:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787733971.552892:0:12052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.552941:0:12052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 7 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.552959:0:12052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 7 pid: 6729 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733971.552977:0:12052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12052:1874574705754880:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733971.553274:0:12052:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38900 going to sleep for 11 seconds 00000100:00100000:2.0:1787733971.558729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733971.558871:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690017408 00000100:00100000:3.0:1787733971.558880:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690017408 00000100:00100000:1.0:1787733971.558880:0:12052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12052:1874574705754880:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733971.558914:0:12052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.558925:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 8 pid: 6729 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733971.558957:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1787733971.558968:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2355:x1874574690017408:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733971.558987:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733971.559017:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 8 pid: 6729 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.559032:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 8 pid: 6729 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.559058:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d5e38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195c4 expref: 8 pid: 6729 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.559095:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787733971.559100:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787733971.559107:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.559117:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.559149:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733971.559205:0:12052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.559214:0:12052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.559242:0:12052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.559257:0:12052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.559265:0:12052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733971.559268:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690017408:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 301us (554us total) trans 0 rc 0/0 00010000:00010000:1.0:1787733971.559274:0:12052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc800 already unused, calling callback (ffffffffc14fc230) 00000100:00100000:3.0:1787733971.559277:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00010000:00010000:1.0:1787733971.559279:0:12052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.559289:0:12052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.559301:0:12052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.559309:0:12052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d5e5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733971.559366:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574690017280:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 6621us (6888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733971.559836:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:3.0:1787733971.564265:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.564319:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690017664 00000100:00100000:1.0:1787733971.564333:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690017664 00000100:00100000:1.0:1787733971.564536:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:1.0:1787733971.564568:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:10535:x1874574690017664:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787733971.564685:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.564706:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.564720:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.564992:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.565004:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195af expref: 15 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.565010:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.565055:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195af expref: 15 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.565068:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195af expref: 15 pid: 8190 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733971.565087:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705755008:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733971.565231:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38900 going to sleep for 11 seconds 00000100:00100000:1.0:1787733971.570576:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705755008:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733971.570618:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733971.570736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733971.570789:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690017792 00000100:00100000:3.0:1787733971.570799:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690017792 00010000:00010000:3.0:1787733971.570846:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195af expref: 16 pid: 8190 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733971.570883:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1787733971.570894:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:2355:x1874574690017792:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733971.570914:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733971.570924:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195af expref: 16 pid: 8190 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.570935:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195af expref: 16 pid: 8190 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.570962:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5e1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195af expref: 16 pid: 8190 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.570976:0:11156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ed3d91a00) 00010000:00010000:3.0:1787733971.570980:0:11156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.570989:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.570994:0:11156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.571013:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733971.571036:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.571052:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787733971.571346:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000100:00100000:3.0:1787733971.571562:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:2355:x1874574690017792:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 668us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733971.571570:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000001:00080000:1.0:1787733971.571704:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787733971.571751:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787733971.571847:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705755136:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787733971.571909:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733971.571950:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787733971.572305:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705755136 00000100:00100000:3.0:1787733971.572312:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705755136 00000100:00100000:3.0:1787733971.572500:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787733971.572508:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874574705755136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787733971.572579:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874574705755136:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733971.572586:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787733971.572608:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787733971.572614:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1787733971.572633:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891eefd85f80, transno 4294967309 00000100:00100000:1.0:1787733971.572670:0:5833:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff891eefd84e00 x1874574705754240/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787733987 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787733971.572684:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705755136:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787733971.573273:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787733971.573348:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705755264:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787733971.573401:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733971.574016:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38900 going to sleep for 11 seconds 00000100:00100000:3.0:1787733971.574196:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705755264 00000100:00100000:3.0:1787733971.574204:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705755264 00000100:00100000:3.0:1787733971.574249:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787733971.574259:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874574705755264:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787733971.574816:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1874574705755264:12345-0@lo:1000:mdt00_001.0 Request processed in 558us (1414us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787733971.574822:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787733971.574890:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705755264:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787733971.574936:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.574948:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.574962:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.574967:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733971.574971:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.574976:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.574992:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ed3d91a00) 00010000:00010000:1.0:1787733971.574995:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787733971.575000:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.575007:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e69 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.575053:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.575060:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.575404:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.575414:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733971.575417:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.575435:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.575445:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733971.575448:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787733971.575518:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5db3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19593 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.575533:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5db3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19593 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.575543:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5db3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19593 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.575582:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5db3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19593 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733971.575598:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff06300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705755392:192.168.201.34@tcp:105: 00000100:00100000:1.0:1787733971.575701:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38900 going to sleep for 11 seconds 00000100:00100000:2.0:1787733971.579150:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733971.579246:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690017920 00000100:00100000:0.0:1787733971.579256:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690017920 00000100:00100000:0.0:1787733971.579343:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:0.0:1787733971.579354:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:10533:x1874574690017920:12345-192.168.201.34@tcp:49:lfs.0 00000100:00100000:1.0:1787733971.579362:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff06300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705755392:192.168.201.34@tcp:105: 00010000:00010000:1.0:1787733971.579395:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579406:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5dac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579451:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579492:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579506:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579518:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579523:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579530:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579536:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733971.579540:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579548:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579560:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733971.579564:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733971.579568:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579573:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579583:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579595:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579601:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579605:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60ccc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733971.579614:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579621:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579630:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733971.579632:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787733971.579635:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.579649:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733971.579946:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:10535:x1874574690017664:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 15380us (15694us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787733971.579956:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 127 00000020:00080000:1.0:1787733971.579961:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787733971.580008:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:10533:x1874574690017920:12345-192.168.201.34@tcp:49:lfs.0 Request processed in 655us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733971.580015:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000040:00080000:3.0:1787733971.583268:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787733971.583290:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787733971.584653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.584740:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690018176 00000100:00100000:1.0:1787733971.584753:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690018176 00000100:00100000:1.0:1787733971.584823:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 128 00000100:00100000:1.0:1787733971.584834:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:10533:x1874574690018176:12345-192.168.201.34@tcp:58:lfs.0 00000040:00080000:1.0:1787733971.585321:0:8190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787733971.585432:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:10533:x1874574690018176:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 598us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733971.585441:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 128 00000040:00080000:3.0:1787733971.586393:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000100:00100000:0.0:1787733971.586784:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.587122:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690018432 00000100:00100000:1.0:1787733971.587134:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690018432 00000100:00100000:1.0:1787733971.587213:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:1.0:1787733971.587226:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec738f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:10535:x1874574690018432:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1787733971.587707:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:1.0:1787733971.589030:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787733971.589150:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787733971.589238:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.589259:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.589272:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.589294:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.589301:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.589308:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.589333:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787733971.589459:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec738f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:10535:x1874574690018432:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 2231us (2676us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787733971.589478:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000020:00080000:1.0:1787733971.589484:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787733971.594512:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787733971.594534:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.594547:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cce00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787733971.594552:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.594564:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.594588:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff891ec28ef000) 00010000:00010000:3.0:1787733971.594591:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787733971.594598:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.594604:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5e77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733971.594652:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733971.594655:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733971.594657:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733971.622370:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.622484:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690018560 00000100:00100000:1.0:1787733971.622498:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690018560 00000100:00100000:1.0:1787733971.622572:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:1.0:1787733971.622584:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef691b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:10537:x1874574690018560:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787733971.622614:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733971.622652:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.622739:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.622759:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.622771:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.622789:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5e8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.622797:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.622804:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.623237:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.623262:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1958c expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.623272:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.623316:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1958c expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733971.623333:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1958c expref: 21 pid: 5833 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733971.623350:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff06300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705755520:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733971.623473:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38540 going to sleep for 11 seconds 00000100:00100000:1.0:1787733971.629253:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff06300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705755520:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733971.629559:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733971.630211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733971.630321:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690018816 00000100:00100000:1.0:1787733971.630330:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690018816 00000100:00100000:1.0:1787733971.630395:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:1.0:1787733971.630407:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:5591:x1874574690018816:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787733971.630718:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:5591:x1874574690018816:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 312us (510us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787733971.630728:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:1.0:1787733971.634199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733971.634776:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690018944 00000100:00100000:0.0:1787733971.634789:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690018944 00010000:00010000:0.0:1787733971.634842:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1958c expref: 23 pid: 5833 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733971.634890:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:0.0:1787733971.634901:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:2354:x1874574690018944:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733971.634919:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733971.634928:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1958c expref: 23 pid: 5833 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.634944:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1958c expref: 23 pid: 5833 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.634972:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5d9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1958c expref: 23 pid: 5833 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.634997:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:0.0:1787733971.635003:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.635014:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.635023:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733971.635044:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733971.635244:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:2354:x1874574690018944:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 343us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733971.635263:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00010000:00010000:2.0:1787733971.635804:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.635816:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733971.635868:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787733971.635873:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733971.635896:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.635910:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.635931:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.635938:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.635945:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.635952:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733971.635957:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.635966:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.635978:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787733971.635981:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733971.635986:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.635992:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.636008:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.636014:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5e8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.636020:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.636031:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733971.636034:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.636040:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5e8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.636048:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff891ec28ef600) 00010000:00010000:2.0:1787733971.636051:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733971.636053:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5e8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.636059:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5e8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.636113:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5e7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195cb expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.636128:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195cb expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733971.636136:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:2.0:1787733971.636138:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787733971.636140:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cd000, rc 0) 00000100:00100000:2.0:1787733971.636202:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef691b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:10537:x1874574690018560:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 13620us (13844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733971.636211:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 129 00010000:00010000:0.0:1787733972.410372:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787733972.478817:0:12090:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787733972.478829:0:12090:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787733972.478887:0:12090:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787733972.478894:0:12090:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787733972.601876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733972.601921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733972.601958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733972.601980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733972.602008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733972.602044:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690019456 00000100:00100000:0.0:1787733972.602067:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690019456 00000100:00100000:0.0:1787733972.602138:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690019328 00000100:00100000:0.0:1787733972.602142:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690019328 00000100:00100000:0.0:1787733972.602194:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:0.0:1787733972.602207:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2357:x1874574690019456:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733972.602302:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2357:x1874574690019456:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 98us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733972.602310:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:0.0:1787733972.602333:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:0.0:1787733972.602340:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2356:x1874574690019328:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733972.602366:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2356:x1874574690019328:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733972.602372:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:0.0:1787733972.602390:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690019072 00000100:00100000:0.0:1787733972.602393:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690019072 00000100:00100000:0.0:1787733972.602420:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 279 00000100:00100000:0.0:1787733972.602425:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2356:x1874574690019072:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733972.602696:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2356:x1874574690019072:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 270us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733972.602703:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 279 00000100:00100000:0.0:1787733972.602739:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690019200 00000100:00100000:0.0:1787733972.602743:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690019200 00000100:00100000:0.0:1787733972.602772:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690019584 00000100:00100000:0.0:1787733972.602774:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690019584 00000100:00100000:0.0:1787733972.602794:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:0.0:1787733972.602801:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:2357:x1874574690019200:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733972.602833:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:2357:x1874574690019200:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 33us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733972.602839:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:0.0:1787733972.602850:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:0.0:1787733972.602856:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2356:x1874574690019584:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733972.602875:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2356:x1874574690019584:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 20us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733972.602881:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00080000:0.0:1787733972.602895:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787733972.602900:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787733972.666577:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787733972.666589:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787733972.666662:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787733972.666670:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787733972.666834:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefd86d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705755648:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787733972.666957:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733972.671850:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefd86d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705755648:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787733972.672233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733972.672270:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690019712 00000100:00100000:0.0:1787733972.672278:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690019712 00000100:00100000:0.0:1787733972.672345:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:0.0:1787733972.672357:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefdab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:10549:x1874574690019712:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787733972.672394:0:8190:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787733972.672552:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefdab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:10549:x1874574690019712:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 196us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733972.672560:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:0.0:1787733972.676939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733972.677181:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690019968 00000100:00100000:1.0:1787733972.677194:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690019968 00000100:00100000:1.0:1787733972.677269:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1787733972.677281:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:10549:x1874574690019968:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787733972.677307:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733972.677335:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e9a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195d2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.681257:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.681288:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.681303:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733972.681324:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787733972.681913:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d5e9a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195d2 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.681949:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195d2 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.681960:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733972.681963:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787733972.681968:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc200, rc 0) 00000100:00100000:1.0:1787733972.682079:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:10549:x1874574690019968:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 4798us (5154us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787733972.682107:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:0.0:1787733972.686865:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733972.686952:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690020224 00000100:00100000:1.0:1787733972.686966:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690020224 00000100:00100000:1.0:1787733972.687039:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:1.0:1787733972.687060:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:10549:x1874574690020224:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787733972.687186:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5eaf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.687207:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.687220:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.687470:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.687478:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5eaf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.687485:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5eaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.687493:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cce00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733972.687498:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5eaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.687506:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5eaf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.687544:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733972.687547:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787733972.687553:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5eaf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.687559:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d5eaf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733972.687749:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:10549:x1874574690020224:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 699us (899us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787733972.687759:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 132 00000040:00080000:3.0:1787733972.688141:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787733972.688147:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787733972.688798:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787733972.688809:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787733972.691415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733972.691570:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690020480 00000100:00100000:1.0:1787733972.691583:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690020480 00000100:00100000:1.0:1787733972.691666:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1787733972.691678:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:10549:x1874574690020480:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787733972.696678:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:10549:x1874574690020480:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 4987us (5262us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787733972.696696:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1787733972.702720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733972.707190:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690020608 00000100:00100000:1.0:1787733972.707210:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690020608 00000100:00100000:1.0:1787733972.707315:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1787733972.707328:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:2355:x1874574690020608:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733972.707347:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733972.707379:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d5ea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195d2 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733972.707407:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:1.0:1787733972.707413:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733972.708228:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:2355:x1874574690020608:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 898us (5517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733972.708246:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1787733972.794667:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705755776:0@lo:400:kworker.0 00000100:00100000:0.0:1787733972.794765:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733972.794923:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705755904:0@lo:400:kworker.0 00000100:00100000:2.0:1787733972.794976:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733972.795045:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705756416:0@lo:400:kworker.0 00000100:00100000:2.0:1787733972.795073:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733972.795119:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787733972.795125:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705756032:0@lo:400:kworker.0 00000100:00100000:2.0:1787733972.795150:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733972.795228:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705755904 00000100:00100000:2.0:1787733972.795239:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705755904 00000100:00100000:2.0:1787733972.795288:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705756032 00000100:00100000:2.0:1787733972.795292:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705756032 00000100:00100000:2.0:1787733972.795324:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787733972.795334:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705755904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733972.795389:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705755904:12345-0@lo:400:kworker.0 Request processed in 56us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733972.795396:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787733972.795412:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787733972.795416:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705756032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733972.795825:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705756160:0@lo:400:kworker.0 00000100:00100000:1.0:1787733972.795892:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705755776 00000100:00100000:1.0:1787733972.795896:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705755776 00000100:00100000:1.0:1787733972.795922:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787733972.795927:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705755776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733972.796759:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705756288:0@lo:400:kworker.0 00000100:00100000:0.0:1787733972.796807:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733972.796854:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705756288 00000100:00100000:0.0:1787733972.796860:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705756288 00000100:00100000:0.0:1787733972.796893:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787733972.796901:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705756288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733972.796947:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705756288:12345-0@lo:400:kworker.0 Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733972.796955:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1787733972.796978:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787733972.797023:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705756288:0@lo:400:kworker.0 00000100:00100000:2.0:1787733972.798995:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705756032:12345-0@lo:400:kworker.0 Request processed in 3563us (3829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733972.799012:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787733972.799070:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705756416 00000100:00100000:0.0:1787733972.799080:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705756416 00000100:00100000:2.0:1787733972.799180:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705756032:0@lo:400:kworker.0 00000100:00100000:0.0:1787733972.799193:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787733972.799201:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705755904:0@lo:400:kworker.0 00000100:00100000:0.0:1787733972.799203:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3310:x1874574705756416:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787733972.799247:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787733972.799301:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3310:x1874574705756416:12345-0@lo:400:kworker.0 Request processed in 101us (4226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733972.799328:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787733972.799334:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705756416:0@lo:400:kworker.0 00000100:00100000:3.0:1787733972.800026:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733972.800182:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705756160 00000100:00100000:0.0:1787733972.800189:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705756160 00000100:00100000:0.0:1787733972.800229:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787733972.800237:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1874574705756160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733972.800286:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1874574705756160:12345-0@lo:400:kworker.0 Request processed in 50us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733972.800292:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787733972.800468:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705756160:0@lo:400:kworker.0 00000100:00100000:0.0:1787733972.800835:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705755776:12345-0@lo:400:kworker.0 Request processed in 4906us (6068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733972.800844:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787733972.800956:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705755776:0@lo:400:kworker.0 00000100:00100000:0.0:1787733973.307388:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787733973.307418:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705756544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787733973.307752:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733973.308691:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705756544 00000100:00100000:3.0:1787733973.308704:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705756544 00000100:00100000:3.0:1787733973.308785:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787733973.308796:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874574705756544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787733973.308905:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733973.309806:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874574705756544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 999us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733973.309824:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787733973.310054:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705756544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787733973.435707:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733973.819693:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787733973.819727:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefd85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705756672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787733973.819824:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733973.819960:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705756672 00000100:00100000:3.0:1787733973.819972:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705756672 00000100:00100000:3.0:1787733973.820061:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787733973.820074:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705756672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787733973.820119:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733973.820201:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705756672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733973.820209:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787733973.820264:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefd85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705756672:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787733973.820515:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787733974.465102:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787733974.593659:0:12142:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787733974.593670:0:12142:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787733974.593715:0:12142:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787733974.593722:0:12142:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787733974.753678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733974.753767:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690020864 00000100:00100000:3.0:1787733974.753779:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690020864 00000100:00100000:3.0:1787733974.753870:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:3.0:1787733974.753884:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:10569:x1874574690020864:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733974.753916:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733974.753943:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5eb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195d9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733974.754072:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5ebd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733974.754089:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5ebd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733974.754115:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5ebd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733974.754130:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787733974.754312:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5eb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195d9 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733974.754332:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5ebd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195d9 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733974.754343:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:3.0:1787733974.754346:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787733974.754350:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7eda00, rc 0) 00000100:00100000:3.0:1787733974.754421:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:10569:x1874574690020864:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 540us (756us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787733974.754430:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00080000:1.0:1787733974.754676:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733974.760298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733974.763319:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690020992 00000100:00100000:0.0:1787733974.763338:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690020992 00000100:00100000:0.0:1787733974.763419:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:0.0:1787733974.763431:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:10569:x1874574690020992:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787733974.763518:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5ecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.763541:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.763554:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.763637:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.763645:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5ecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.763652:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.763658:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733974.763663:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.763672:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5ecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.763687:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:0.0:1787733974.763691:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787733974.763696:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5ecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.763703:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d5ecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733974.763923:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:10569:x1874574690020992:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 493us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733974.763932:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:3.0:1787733974.920615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733974.920811:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690021120 00000100:00100000:0.0:1787733974.920824:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690021120 00000100:00100000:0.0:1787733974.920921:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:0.0:1787733974.920955:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2357:x1874574690021120:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1787733974.920978:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733974.921006:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008de4c3a6/0x45228d86de4d5ed2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195e0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787733974.921039:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8ea7d3, atime: 0x6a8ea7d3, ctime: 0x6a8ea7d3, blocks: 0xb 00010000:00010000:0.0:1787733974.921064:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=292s v=(0 0) 00010000:00010000:0.0:1787733974.921069:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787733974.921082:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008de4c3a6/0x45228d86de4d5ed2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e0 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.921105:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008de4c3a6/0x45228d86de4d5ed2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e0 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733974.921121:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659c00, rc 0) 00000100:00100000:0.0:1787733974.921251:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2357:x1874574690021120:12345-192.168.201.34@tcp:101:cat.0 Request processed in 301us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733974.921259:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00080000:1.0:1787733974.921872:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787733974.929992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733974.930266:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690021248 00000100:00100000:1.0:1787733974.930279:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690021248 00002000:00100000:1.0:1787733974.930363:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff891eef7a9880 x1874574690021248/t0(0) o3->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:440/0 lens 488/0 e 0 to 0 dl 1787733985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787733974.930377:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891eef7a9880 with x1874574690021248 ext(0->4095) 00002000:00010000:1.0:1787733974.930384:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891eef7a9880 00000100:00100000:1.0:1787733974.930421:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1787733974.930434:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2357:x1874574690021248:12345-192.168.201.34@tcp:3:cat.0 00000100:00100000:1.0:1787733974.930899:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2357:x1874574690021248:12345-192.168.201.34@tcp:3:cat.0 Request processed in 465us (919us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787733974.930909:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00002000:00100000:1.0:1787733974.930918:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff891eef7a9880 x1874574690021248/t0(0) o3->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:440/0 lens 488/4536 e 0 to 0 dl 1787733985 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787733974.930933:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891eef7a9880 with x1874574690021248 ext(0->4095) 00002000:00010000:1.0:1787733974.930937:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891eef7a9880 00010000:00010000:0.0:1787733975.495186:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787733975.515810:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787733975.515834:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1787733975.515849:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:3.0:1787733976.507907:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787733976.957511:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1787733976.957526:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787733976.957532:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787733976.964901:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1787733976.964930:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff891efec386c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787733976.964936:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891efe50b100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff891efec38cc0 00000020:00080000:0.0:1787733976.964939:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891efe50bd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff891efec47c00 00000020:00080000:0.0:1787733976.964975:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1787733976.964986:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787733976.965037:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787733976.965275:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787733977.538258:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733977.716515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733977.716636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733977.717778:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690021504 00000100:00100000:1.0:1787733977.717792:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690021504 00000100:00100000:1.0:1787733977.717878:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:1.0:1787733977.717889:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:2357:x1874574690021504:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:2.0:1787733977.717947:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733977.717980:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:2357:x1874574690021504:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 93us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733977.717987:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:2.0:1787733977.719228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733977.719273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733977.719306:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733977.719329:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690021888 00000100:00100000:2.0:1787733977.719335:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690021888 00000100:00100000:1.0:1787733977.719475:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690021760 00000100:00100000:3.0:1787733977.719479:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690021632 00000100:00100000:1.0:1787733977.719479:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690021760 00000100:00100000:3.0:1787733977.719483:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690021632 00000100:00100000:2.0:1787733977.719548:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:2.0:1787733977.719558:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2356:x1874574690021888:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733977.719615:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2356:x1874574690021888:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 59us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733977.719622:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:0.0:1787733977.719637:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690021376 00000100:00100000:0.0:1787733977.719642:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690021376 00000100:00100000:2.0:1787733977.719741:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 281 00000100:00100000:2.0:1787733977.719748:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2357:x1874574690021376:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733977.719785:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2357:x1874574690021376:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 38us (3282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733977.719792:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 281 00000100:00100000:1.0:1787733977.722857:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:1.0:1787733977.722874:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574690021760:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733977.722969:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574690021760:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 99us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733977.722977:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:1.0:1787733977.722992:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:1.0:1787733977.722999:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2356:x1874574690021632:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733977.723026:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2356:x1874574690021632:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (3752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733977.723032:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00080000:0.0:1787733977.726897:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787733977.726908:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787733977.726912:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787733977.917589:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705757184:0@lo:400:kworker.0 00000100:00100000:0.0:1787733977.917673:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733977.917748:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787733977.917755:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705756800:0@lo:400:kworker.0 00000100:00100000:0.0:1787733977.917787:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733977.917810:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705757312:0@lo:400:kworker.0 00000100:00100000:0.0:1787733977.917835:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733977.917866:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705756800 00000100:00100000:0.0:1787733977.917873:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705756800 00000100:00100000:0.0:1787733977.917916:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787733977.917925:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705756800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733977.917983:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705756800:12345-0@lo:400:kworker.0 Request processed in 59us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733977.917990:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787733977.918037:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705756800:0@lo:400:kworker.0 00000100:00100000:1.0:1787733977.918274:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705757184 00000100:00100000:2.0:1787733977.918277:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705756928:0@lo:400:kworker.0 00000100:00100000:1.0:1787733977.918278:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705757184 00000100:00100000:2.0:1787733977.918307:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733977.918329:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705757440:0@lo:400:kworker.0 00000100:00100000:1.0:1787733977.918343:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787733977.918350:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705757184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733977.918360:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733977.918387:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787733977.918392:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705757184:12345-0@lo:400:kworker.0 Request processed in 43us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733977.918393:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705757056:0@lo:400:kworker.0 00000100:00100000:1.0:1787733977.918399:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787733977.918410:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705757440 00000100:00100000:1.0:1787733977.918413:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705757440 00000100:00100000:2.0:1787733977.918414:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733977.918435:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787733977.918440:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705757312 00000100:00100000:1.0:1787733977.918441:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705757440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733977.918443:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705757312 00000100:00100000:2.0:1787733977.918468:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705756928 00000100:00100000:2.0:1787733977.918471:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705756928 00000100:00100000:1.0:1787733977.918472:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705757440:12345-0@lo:400:kworker.0 Request processed in 31us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733977.918477:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787733977.918482:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705757056 00000100:00100000:2.0:1787733977.918484:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705757056 00000100:00100000:2.0:1787733977.918498:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787733977.918500:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000100:00100000:2.0:1787733977.918503:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705757312:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1787733977.918505:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891eefd84e00, transno 4294967310 00000004:00080000:1.0:1787733977.918514:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787733977.918542:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705757184:0@lo:400:kworker.0 00000100:00100000:2.0:1787733977.918544:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705757312:12345-0@lo:400:kworker.0 Request processed in 40us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733977.918550:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787733977.918561:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787733977.918561:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705757312:0@lo:400:kworker.0 00000100:00100000:2.0:1787733977.918567:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705756928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733977.918592:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705756928:12345-0@lo:400:kworker.0 Request processed in 25us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733977.918598:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787733977.918601:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787733977.918608:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705757056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733977.918637:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705757056:12345-0@lo:400:kworker.0 Request processed in 30us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733977.918643:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787733977.918931:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705757056:0@lo:400:kworker.0 00000100:00100000:2.0:1787733977.918941:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705756928:0@lo:400:kworker.0 00000100:00100000:2.0:1787733977.918948:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787733977.918952:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787733977.918975:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891eef7ab800, transno 4294967304 00000100:00100000:2.0:1787733977.918993:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705757440:0@lo:400:kworker.0 00000100:00080000:0.0:1787733977.920059:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787733977.920066:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787733977.920068:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787733978.427222:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787733978.427257:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705757568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787733978.427324:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733978.427467:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705757568 00000100:00100000:1.0:1787733978.427476:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705757568 00000100:00100000:1.0:1787733978.427539:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787733978.427549:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705757568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787733978.427589:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787733978.427638:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705757568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733978.427645:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787733978.427736:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705757568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787733978.554291:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733978.943315:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705757696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787733978.943394:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733978.943462:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705757696 00000100:00100000:2.0:1787733978.943470:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705757696 00000100:00100000:2.0:1787733978.944302:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787733978.944316:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705757696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787733978.944363:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733978.944424:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705757696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733978.944432:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787733978.944785:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705757696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787733979.123580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733979.123762:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690022016 00000100:00100000:0.0:1787733979.123773:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690022016 00000100:00100000:0.0:1787733979.123866:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:0.0:1787733979.123880:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:10214:x1874574690022016:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787733979.124004:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:10214:x1874574690022016:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 Request processed in 128us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733979.124012:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00080000:2.0:1787733979.125237:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733979.127536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733979.127623:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690022272 00000100:00100000:0.0:1787733979.127632:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690022272 00000100:00100000:0.0:1787733979.127688:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:0.0:1787733979.127706:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:10214:x1874574690022272:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787733979.128664:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:10214:x1874574690022272:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 965us (1135us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787733979.128674:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:3.0:1787733979.421520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733979.421619:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690022400 00000100:00100000:1.0:1787733979.421629:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690022400 00000100:00100000:1.0:1787733979.421706:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:1.0:1787733979.421716:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:11021:x1874574690022400:12345-192.168.201.34@tcp:101:lsof.0 00010000:00010000:1.0:1787733979.421735:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733979.421756:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5ed9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733979.421828:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733979.421841:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733979.421854:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733979.422068:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787733979.422073:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787733979.422209:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733979.422237:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d5ed9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e7 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733979.422272:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e7 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733979.422280:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:1.0:1787733979.422283:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787733979.422286:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60ccc00, rc 0) 00000100:00080000:2.0:1787733979.422582:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733979.422622:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:11021:x1874574690022400:12345-192.168.201.34@tcp:101:lsof.0 Request processed in 906us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733979.422631:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 136 00010000:00010000:3.0:1787733979.579395:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733980.603214:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787733980.858565:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733980.858576:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787733980.858928:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787733980.858935:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787733981.626844:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787733982.003061:0:12343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:46:21 (1787733981) 00000001:00080000:1.0:1787733982.099146:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787733982.099197:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787733982.099223:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787733982.099231:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787733982.651287:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733982.836830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733982.836926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733982.836974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733982.836998:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690022912 00000100:00100000:3.0:1787733982.837010:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690022912 00000100:00100000:2.0:1787733982.837015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733982.837077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733982.837082:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690022784 00000100:00100000:3.0:1787733982.837093:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690022784 00000100:00100000:3.0:1787733982.837117:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:3.0:1787733982.837126:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574690022912:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733982.837133:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690022528 00000100:00100000:1.0:1787733982.837140:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690022528 00000100:00100000:1.0:1787733982.837202:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 283 00000100:00100000:1.0:1787733982.837212:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574690022528:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733982.837239:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574690022912:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733982.837249:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574690022528:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733982.837253:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:1.0:1787733982.837263:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 283 00000100:00100000:3.0:1787733982.837289:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:3.0:1787733982.837300:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574690022784:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733982.837332:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574690022784:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733982.837340:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00080000:1.0:1787733982.837346:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787733982.837352:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787733982.841784:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690022656 00000100:00100000:0.0:1787733982.841799:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690022656 00000100:00100000:0.0:1787733982.841886:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690023040 00000100:00100000:0.0:1787733982.841890:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690023040 00000100:00100000:0.0:1787733982.841928:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:0.0:1787733982.841940:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:2354:x1874574690022656:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733982.842025:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:2354:x1874574690022656:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 87us (5205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733982.842033:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:0.0:1787733982.842049:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:0.0:1787733982.842071:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:2354:x1874574690023040:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733982.842112:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:2354:x1874574690023040:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 57us (5036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733982.842119:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00080000:2.0:1787733982.842495:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733982.900397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733982.900689:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690023296 00000100:00100000:0.0:1787733982.900699:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690023296 00000100:00100000:0.0:1787733982.900762:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:0.0:1787733982.900775:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:11286:x1874574690023296:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787733982.900795:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733982.900816:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5ee7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195ee expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.900887:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5eee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.900901:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5eee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.900912:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5eee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.900927:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5ef5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.900933:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.900940:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902212:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5efc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902234:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5efc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902243:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5efc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733982.902253:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787733982.902507:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5eee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902514:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5eee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902521:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5eee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902527:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733982.902531:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5eee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902538:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5eee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902549:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff891ed3d91500) 00010000:00010000:0.0:1787733982.902552:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733982.902556:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5eee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902561:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5eee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902573:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902585:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5ef5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902590:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902595:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733982.902597:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902603:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902611:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff891ec6771e00) 00010000:00010000:0.0:1787733982.902613:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733982.902615:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5ef5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902621:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d5ef5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902972:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d5ee7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195ee expref: 16 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902986:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5efc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195ee expref: 15 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733982.902993:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:0.0:1787733982.902995:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733982.903003:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659800, rc 0) 00000100:00100000:0.0:1787733982.903072:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:11286:x1874574690023296:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2300us (2685us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787733982.903082:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:0.0:1787733982.907665:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733982.907743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690023424 00000100:00100000:3.0:1787733982.907753:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690023424 00000100:00100000:3.0:1787733982.907817:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:3.0:1787733982.907828:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:11286:x1874574690023424:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787733982.907942:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:11286:x1874574690023424:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733982.907950:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:2.0:1787733982.910353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733982.910490:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690023552 00000100:00100000:1.0:1787733982.910498:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690023552 00000100:00100000:1.0:1787733982.910556:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1787733982.910565:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:2356:x1874574690023552:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733982.910581:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733982.910608:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d5efc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195ee expref: 15 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733982.910628:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:1.0:1787733982.910633:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733982.910693:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:2356:x1874574690023552:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 129us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733982.910724:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1787733983.035356:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705757824:0@lo:400:kworker.0 00000100:00100000:0.0:1787733983.035420:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733983.035492:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705758336:0@lo:400:kworker.0 00000100:00100000:1.0:1787733983.035498:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874574705758080:0@lo:400:kworker.0 00000100:00100000:0.0:1787733983.035527:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733983.035535:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705758208:0@lo:400:kworker.0 00000100:00100000:1.0:1787733983.035561:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733983.035575:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705757824 00000100:00100000:0.0:1787733983.035583:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705757824 00000100:00100000:1.0:1787733983.035606:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705758208 00000100:00100000:1.0:1787733983.035610:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705758208 00000100:00100000:0.0:1787733983.035634:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787733983.035647:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705757824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733983.035649:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787733983.035658:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705758208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733983.035700:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705758208:12345-0@lo:400:kworker.0 Request processed in 44us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733983.035706:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787733983.035713:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705757824:12345-0@lo:400:kworker.0 Request processed in 69us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733983.035721:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787733983.035743:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705758208:0@lo:400:kworker.0 00000100:00100000:0.0:1787733983.035756:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705758336 00000100:00100000:0.0:1787733983.035762:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705758336 00000100:00100000:0.0:1787733983.035794:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787733983.035800:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733983.035806:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705758336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733983.035837:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705758336:12345-0@lo:400:kworker.0 Request processed in 35us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733983.035843:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787733983.035867:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705758336:0@lo:400:kworker.0 00000100:00100000:0.0:1787733983.035877:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705757824:0@lo:400:kworker.0 00000100:00100000:1.0:1787733983.035960:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787733983.035967:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705757952:0@lo:400:kworker.0 00000100:00100000:0.0:1787733983.035975:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705758080 00000100:00100000:0.0:1787733983.035980:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705758080 00000100:00100000:1.0:1787733983.035995:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787733983.036040:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787733983.036046:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787733983.036107:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705758464:0@lo:400:kworker.0 00000100:00100000:0.0:1787733983.036117:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705757952 00000100:00100000:0.0:1787733983.036122:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705757952 00000100:00100000:1.0:1787733983.036128:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733983.036153:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787733983.036176:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705758464 00000100:00100000:1.0:1787733983.036179:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705758464 00000100:00100000:0.0:1787733983.036185:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874574705758080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733983.036212:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787733983.036228:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874574705758080:12345-0@lo:400:kworker.0 Request processed in 46us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733983.036235:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787733983.036248:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787733983.036271:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705758464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733983.036296:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705758464:12345-0@lo:400:kworker.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733983.036300:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787733983.036323:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705757952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733983.036337:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705758464:0@lo:400:kworker.0 00000100:00100000:1.0:1787733983.036346:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874574705758080:0@lo:400:kworker.0 00000100:00100000:0.0:1787733983.036368:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705757952:12345-0@lo:400:kworker.0 Request processed in 113us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733983.036373:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705757952:0@lo:400:kworker.0 00000100:00100000:0.0:1787733983.036380:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1787733983.036459:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787733983.548053:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705758592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787733983.548129:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733983.548237:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705758592 00000100:00100000:3.0:1787733983.549097:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705758592 00000100:00100000:2.0:1787733983.551326:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787733983.551339:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705758592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787733983.551372:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733983.551458:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705758592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (3330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733983.551466:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787733983.551993:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705758592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787733983.675256:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787733983.934474:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787733983.934484:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787733983.934537:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787733983.934543:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787733984.068218:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787733984.068240:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733984.068312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733984.068481:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705758720 00000100:00100000:2.0:1787733984.068490:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705758720 00000100:00100000:2.0:1787733984.068545:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787733984.068556:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705758720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787733984.068589:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733984.068638:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705758720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733984.068645:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787733984.068689:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787733984.575836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733984.575918:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690023680 00000100:00100000:2.0:1787733984.575927:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690023680 00000100:00100000:2.0:1787733984.576003:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:2.0:1787733984.576014:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:11328:x1874574690023680:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733984.576033:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733984.576063:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5f0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576176:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5f11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576191:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5f11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576204:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5f11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576219:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5f18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576236:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5f18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576244:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5f18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576508:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5f11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576517:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5f11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576523:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5f11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576530:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733984.576534:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5f11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576552:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5f11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576564:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:2.0:1787733984.576567:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733984.576572:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5f11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576577:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d5f11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576589:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5f18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576595:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5f18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576600:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5f18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576604:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733984.576607:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5f18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576612:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5f18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576618:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff891ee0dfc800) 00010000:00010000:2.0:1787733984.576621:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733984.576623:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5f18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576637:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d5f18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576670:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5f0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195f5 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576680:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:2.0:1787733984.576683:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733984.576686:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d5f0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195f5 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.576695:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca800, rc 0) 00000100:00100000:2.0:1787733984.576750:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:11328:x1874574690023680:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 738us (924us total) trans 0 rc 301/301 00000100:00100000:2.0:1787733984.576757:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00080000:0.0:1787733984.578199:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733984.588712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733984.588912:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690023936 00000100:00100000:0.0:1787733984.588921:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690023936 00000100:00100000:1.0:1787733984.589255:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:1.0:1787733984.589269:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:11328:x1874574690023936:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:1.0:1787733984.589432:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733984.589461:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5888 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1942e expref: 14 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.589494:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:1.0:1787733984.589499:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733984.589752:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.589766:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e7 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.589775:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.589808:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e7 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.589821:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e7 expref: 5 pid: 5834 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733984.589834:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705758848:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733984.590073:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed12ce000 going to sleep for 11 seconds 00000100:00100000:1.0:1787733984.593958:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705758848:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733984.594953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733984.594993:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690024064 00000100:00100000:0.0:1787733984.594999:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690024064 00010000:00010000:0.0:1787733984.595051:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e7 expref: 6 pid: 5834 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733984.595082:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:0.0:1787733984.595099:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:2355:x1874574690024064:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733984.595114:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733984.595120:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e7 expref: 6 pid: 5834 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733984.595134:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e7 expref: 6 pid: 5834 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733984.595172:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5ee0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e7 expref: 6 pid: 5834 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733984.595190:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:0.0:1787733984.595195:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733984.595204:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733984.595212:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733984.595241:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733984.595405:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.595425:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.595431:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.595460:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.595470:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.595477:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733984.596409:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2355:x1874574690024064:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 1307us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733984.596430:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00080000:0.0:1787733984.596463:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787733984.597645:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787733984.597660:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.597670:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.597677:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.597682:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733984.597687:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.597694:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.597709:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771700) 00010000:00010000:1.0:1787733984.597712:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733984.597717:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.597734:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f1f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733984.597756:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009230d74e reply state 00000000d1b5b9a2 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733984.597764:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787733984.597834:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:11328:x1874574690023936:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 8568us (9131us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787733984.597855:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 140 00010000:00010000:2.0:1787733984.614211:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.614240:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.614248:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.614254:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733984.614259:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.614267:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.614299:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff891ec28ef300) 00010000:00010000:2.0:1787733984.614303:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733984.614308:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.614314:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f26 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733984.698564:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733984.709111:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733984.709647:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690024192 00000100:00100000:2.0:1787733984.709657:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690024192 00000100:00100000:2.0:1787733984.709708:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:2.0:1787733984.709718:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+14:11336:x1874574690024192:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:2.0:1787733984.709743:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733984.709766:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5f2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df195fc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.709837:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5f34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.709850:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.709861:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733984.709920:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787733984.709924:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733984.709949:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.709985:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5f2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195fc expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.710003:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5f34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195fc expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.710013:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0dfc800) 00010000:00010000:2.0:1787733984.710016:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787733984.710020:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030c00, rc 0) 00000100:00100000:2.0:1787733984.710081:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:11336:x1874574690024192:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 365us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733984.710088:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:1.0:1787733984.807287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733984.807375:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690024320 00000100:00100000:3.0:1787733984.807386:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690024320 00000100:00100000:3.0:1787733984.807451:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 142 00000100:00100000:3.0:1787733984.807462:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+15:11342:x1874574690024320:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787733984.807495:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733984.807517:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5f3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19603 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807579:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5f42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807593:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5f42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807604:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5f42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807618:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5f49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807626:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807632:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807736:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5f50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807744:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807750:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733984.807780:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787733984.807788:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787733984.807810:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807822:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5f42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807828:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5f42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807835:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5f42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807840:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733984.807844:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5f42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807851:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5f42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807862:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0dfc800) 00010000:00010000:3.0:1787733984.807864:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733984.807868:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5f42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807874:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5f42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807887:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807892:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5f49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807906:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5f49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807911:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ed600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733984.807914:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5f49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807919:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5f49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807926:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff891ec6634100) 00010000:00010000:3.0:1787733984.807928:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733984.807931:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5f49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807936:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5f49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807965:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5f3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19603 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807978:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5f50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19603 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.807985:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:3.0:1787733984.807987:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787733984.807989:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ede00, rc 0) 00000100:00100000:3.0:1787733984.808037:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:11342:x1874574690024320:12345-192.168.201.34@tcp:101:bash.0 Request processed in 578us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733984.808052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 142 00000100:00100000:2.0:1787733984.811589:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733984.811804:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690024576 00000100:00100000:1.0:1787733984.811814:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690024576 00000100:00100000:1.0:1787733984.811876:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:1.0:1787733984.811885:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+16:11342:x1874574690024576:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787733984.811904:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733984.811924:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1960a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.812058:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.812073:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.812083:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.812491:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.812513:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.812521:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787733984.813465:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787733984.813624:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813635:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813642:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813674:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813681:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813688:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813694:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733984.813697:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813704:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813726:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:1.0:1787733984.813728:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733984.813733:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813739:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d5f5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733984.813752:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051d98fac reply state 00000000bc8221a4 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733984.813759:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787733984.813787:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d5f57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1960a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813801:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1960a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.813808:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec28efd00) 00010000:00010000:1.0:1787733984.813810:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787733984.813812:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cd600, rc 0) 00000100:00100000:1.0:1787733984.814102:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:11342:x1874574690024576:12345-192.168.201.34@tcp:101:bash.0 Request processed in 2217us (2532us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787733984.814110:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 143 00010000:00010000:1.0:1787733984.819212:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.819239:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.819269:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733984.819291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:1.0:1787733984.819641:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60ccc00 already unused, calling callback (ffffffffc1f3a4f0) 00000100:00100000:2.0:1787733984.819646:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690024704 00010000:00010000:1.0:1787733984.819647:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.819658:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733984.819659:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690024704 00010000:00010000:1.0:1787733984.819676:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec28ef100) 00010000:00010000:1.0:1787733984.819680:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733984.819685:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733984.819691:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60ccc00/0x45228d86de4d5f65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733984.819732:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:2.0:1787733984.819744:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574690024704:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733984.819762:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733984.819782:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5f7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19611 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787733984.819809:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787733984.819826:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:2.0:1787733984.819831:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00080000:3.0:1787733984.819832:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787733984.819841:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5f7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19611 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.819885:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5f7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19611 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.819897:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:2.0:1787733984.819954:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574690024704:12345-192.168.201.34@tcp:101:bash.0 Request processed in 212us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733984.822740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733984.822895:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690024832 00000100:00100000:1.0:1787733984.822903:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690024832 00000100:00100000:2.0:1787733984.822984:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:2.0:1787733984.823014:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1787733984.823025:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:11342:x1874574690024832:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733984.823042:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733984.823059:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19618 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.823090:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5f7a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19611 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.823100:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733984.823104:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733984.823109:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.823140:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5f7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19611 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.823247:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5f7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19611 expref: 7 pid: 6682 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733984.823263:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874574705758976:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733984.823346:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e23480 going to sleep for 11 seconds 00000100:00100000:0.0:1787733984.832087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733984.832150:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690024960 00000100:00100000:3.0:1787733984.832183:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690024960 00010000:00010000:3.0:1787733984.832227:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5f7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19611 expref: 8 pid: 6682 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733984.832232:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874574705758976:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733984.832265:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733984.832286:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031000, rc 0) 00000100:00100000:2.0:1787733984.832345:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:11342:x1874574690024832:12345-192.168.201.34@tcp:101:bash.0 Request processed in 9322us (9613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733984.832353:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:3.0:1787733984.832675:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:3.0:1787733984.832689:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690024960:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733984.832704:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733984.832727:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5f7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19611 expref: 7 pid: 6682 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.832742:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5f7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19611 expref: 7 pid: 6682 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.832767:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080b98509/0x45228d86de4d5f7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19611 expref: 7 pid: 6682 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.832783:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733984.832788:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733984.832796:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.832805:0:11156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.832868:0:11156:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733984.832883:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefd84e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11156:1874574705759104:192.168.201.34@tcp:105: 00000100:00100000:3.0:1787733984.833754:0:11156:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787733984.840573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733984.840619:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefd84e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11156:1874574705759104:192.168.201.34@tcp:105: 00010000:00010000:3.0:1787733984.840644:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733984.840698:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574690024960:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 8013us (8621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733984.840709:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1787733984.840794:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690025216 00000100:00100000:1.0:1787733984.840801:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690025216 00000100:00100000:1.0:1787733984.840852:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:1.0:1787733984.840861:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:11342:x1874574690025216:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1787733984.841140:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:11342:x1874574690025216:12345-192.168.201.34@tcp:35:bash.0 Request processed in 279us (578us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787733984.841147:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:0.0:1787733984.894726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733984.894768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733984.894846:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690025344 00000100:00100000:1.0:1787733984.894867:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690025344 00002000:00100000:1.0:1787733984.894912:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff891efed5f100 x1874574690025344/t0(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:450/0 lens 504/0 e 0 to 0 dl 1787733995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787733984.894924:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891efed5f100 with x1874574690025344 ext(0->12) 00002000:00010000:1.0:1787733984.894929:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff891efed5f100 00000100:00100000:1.0:1787733984.894967:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1787733984.894976:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574690025344:12345-192.168.201.34@tcp:4:bash.0 00000100:00100000:1.0:1787733984.895491:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2355:x1874574690025344:12345-192.168.201.34@tcp:4:bash.0 Request processed in 514us (772us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787733984.895499:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00002000:00100000:1.0:1787733984.895505:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff891efed5f100 x1874574690025344/t4294967305(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:450/0 lens 504/448 e 0 to 0 dl 1787733995 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787733984.895514:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891efed5f100 with x1874574690025344 ext(0->12) 00002000:00010000:1.0:1787733984.895518:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff891efed5f100 00000100:00100000:3.0:1787733984.906043:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690025472 00000100:00100000:3.0:1787733984.906059:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690025472 00000100:00100000:3.0:1787733984.906130:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1787733984.906140:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2355:x1874574690025472:12345-192.168.201.34@tcp:16:kworker.0 00000100:00100000:3.0:1787733984.928466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733984.928503:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690025728 00000100:00100000:3.0:1787733984.928513:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690025728 00000100:00100000:3.0:1787733984.929821:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:3.0:1787733984.929832:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:11352:x1874574690025728:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733984.929852:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733984.929870:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1961f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733984.930060:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787733984.931431:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5f88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1961f expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.931449:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0dfc800) 00010000:00010000:3.0:1787733984.931452:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787733984.931458:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1961f expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733984.931473:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec600, rc 0) 00000100:00100000:3.0:1787733984.931576:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:11352:x1874574690025728:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1745us (3119us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787733984.931585:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:2.0:1787733984.952743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733984.953144:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690025984 00000100:00100000:1.0:1787733984.953172:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690025984 00000100:00100000:1.0:1787733984.953228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:1.0:1787733984.953238:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:11352:x1874574690025984:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1787733984.953793:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:11352:x1874574690025984:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 554us (1060us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787733984.953803:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000001:00080000:0.0:1787733984.981648:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1787733984.982423:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574690025472:12345-192.168.201.34@tcp:16:kworker.0 Request processed in 76269us (87638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733984.982436:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:2.0:1787733985.032776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.032867:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690026112 00000100:00100000:0.0:1787733985.032877:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690026112 00000100:00100000:0.0:1787733985.032937:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:0.0:1787733985.032948:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:11358:x1874574690026112:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733985.032972:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733985.032992:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5f96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19626 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.033058:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.033071:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.033084:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733985.033140:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787733985.033144:0:8190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733985.037448:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.037513:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5f96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19626 expref: 23 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.037562:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19626 expref: 22 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.037571:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733985.037574:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787733985.037578:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658e00, rc 0) 00000100:00100000:0.0:1787733985.037760:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:11358:x1874574690026112:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 4812us (4992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733985.037768:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:1.0:1787733985.043349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.044784:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690026368 00000100:00100000:0.0:1787733985.044799:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690026368 00000100:00100000:0.0:1787733985.044920:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 146 00000100:00100000:0.0:1787733985.044932:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:11358:x1874574690026368:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733985.044952:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733985.044971:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5fa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1962d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.045072:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5fab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.045087:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.045098:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733985.045108:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787733985.046435:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5fa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1962d expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.046458:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5fab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1962d expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.046467:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec28efd00) 00010000:00010000:0.0:1787733985.046469:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733985.046473:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659e00, rc 0) 00000100:00100000:0.0:1787733985.046560:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:11358:x1874574690026368:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1630us (3219us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787733985.046569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 146 00000100:00100000:1.0:1787733985.056950:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733985.057003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733985.057067:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690026752 00000100:00100000:3.0:1787733985.057078:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690026752 00000100:00100000:2.0:1787733985.057095:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690026624 00000100:00100000:2.0:1787733985.057100:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690026624 00000100:00100000:2.0:1787733985.057144:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:3.0:1787733985.057150:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1787733985.057184:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:11358:x1874574690026624:12345-192.168.201.34@tcp:101:lfs.0 00000100:00100000:3.0:1787733985.057186:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:2357:x1874574690026752:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733985.057202:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733985.057216:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733985.057237:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d5fab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1962d expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.057257:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5fb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19634 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.057258:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec28efd00) 00010000:00010000:3.0:1787733985.057267:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733985.057331:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:2357:x1874574690026752:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 172us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733985.057339:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00010000:00010000:2.0:1787733985.057355:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5fc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.057368:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.057378:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733985.057391:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787733985.057526:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d5fb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19634 expref: 26 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.057542:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19634 expref: 25 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.057549:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec28efd00) 00010000:00010000:2.0:1787733985.057552:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787733985.057554:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:2.0:1787733985.057577:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:11358:x1874574690026624:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 425us (638us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787733985.057584:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:2.0:1787733985.066521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733985.066596:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690026880 00000100:00100000:1.0:1787733985.066718:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690026880 00000100:00100000:1.0:1787733985.066772:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:1.0:1787733985.066781:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574690026880:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:1.0:1787733985.066825:0:6729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733985.066845:0:6729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733985.066853:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787733985.066858:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787733985.066862:0:6729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733985.066894:0:6729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733985.066907:0:6729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 6 pid: 6682 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733985.066921:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6729:1874574705759232:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733985.067115:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efe973000 going to sleep for 11 seconds 00000100:00100000:1.0:1787733985.079971:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.080202:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690027008 00000100:00100000:0.0:1787733985.080212:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690027008 00010000:00010000:0.0:1787733985.080266:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 7 pid: 6682 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733985.080301:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:0.0:1787733985.080311:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690027008:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733985.080326:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787733985.080345:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787733985.080349:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787733985 00002000:00010000:0.0:1787733985.080351:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787733985 00002000:00010000:0.0:1787733985.080354:0:5817:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1787733985.080359:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 7 pid: 6682 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.080389:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 7 pid: 6682 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.080427:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787733985.080433:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787733985.080440:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.080455:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.080476:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733985.080531:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690027008:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 221us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733985.080539:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00010000:00010000:2.0:1787733985.081490:0:6729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d5f81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19618 expref: 6 pid: 6682 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733985.081509:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6729:1874574705759232:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733985.081541:0:6729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.081552:0:6729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.081559:0:6729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.081583:0:6729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.081592:0:6729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.081600:0:6729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.081607:0:6729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cce00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787733985.081625:0:6729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.081635:0:6729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.081648:0:6729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.081662:0:6729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000460be47/0x45228d86de4d5fce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733985.081737:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2355:x1874574690026880:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 14955us (15226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733985.081746:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:1.0:1787733985.084236:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733985.085854:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690027264 00000100:00100000:2.0:1787733985.085868:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690027264 00000100:00100000:2.0:1787733985.085931:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:2.0:1787733985.085942:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec738fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:11358:x1874574690027264:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:2.0:1787733985.086013:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19634 expref: 25 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787733985.086341:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787733985.086389:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787733985.088848:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787733985.088930:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.090760:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1960a expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.090779:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.090826:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1960a expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.090857:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1960a expref: 29 pid: 5834 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733985.090874:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1874574705759360:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733985.091850:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787733985.093415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733985.093537:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690027392 00000100:00100000:3.0:1787733985.093546:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690027392 00000100:00100000:2.0:1787733985.093595:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1874574705759360:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733985.093596:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1960a expref: 30 pid: 5834 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.093616:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733985.093757:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:3.0:1787733985.093769:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec3d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+30:2355:x1874574690027392:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733985.093784:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733985.093792:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1960a expref: 30 pid: 5834 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.093804:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1960a expref: 30 pid: 5834 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.093824:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d5f6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1960a expref: 30 pid: 5834 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.093841:0:11156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec28efd00) 00010000:00010000:3.0:1787733985.093846:0:11156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.093853:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.093861:0:11156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.093885:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787733985.094003:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.094012:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733985.094051:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec3d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:2355:x1874574690027392:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 284us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733985.094057:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000001:00080000:2.0:1787733985.094149:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787733985.094387:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787733985.095040:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1874574705759488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787733985.095101:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733985.095135:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787733985.095529:0:12051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705759488 00000100:00100000:0.0:1787733985.095536:0:12051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705759488 00000100:00100000:0.0:1787733985.095600:0:12051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787733985.095611:0:12051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5836:x1874574705759488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787733985.095692:0:12051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5836:x1874574705759488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733985.095700:0:12051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787733985.095727:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787733985.095792:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1874574705759488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787733985.096431:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787733985.096566:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1874574705759616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787733985.096602:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733985.096630:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787733985.096737:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705759616 00000100:00100000:3.0:1787733985.096742:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705759616 00000100:00100000:3.0:1787733985.096780:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787733985.096788:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1874574705759616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787733985.097001:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1874574705759616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 214us (399us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787733985.097007:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787733985.097109:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1874574705759616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787733985.097172:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787733985.097207:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.097223:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.097230:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.097236:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733985.097241:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.097248:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.097264:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec28efd00) 00010000:00010000:0.0:1787733985.097276:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787733985.097280:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.097287:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d5fd5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787733985.097481:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787733985.097571:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787733985.097582:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303086425511ns, next at 304086423059ns, rc = 0 00000001:00080000:0.0:1787733985.097588:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787733985.097625:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec28efd00) 00010000:00010000:0.0:1787733985.097628:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787733985.097634:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5fc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19634 expref: 33 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733985.097727:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec738fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:11358:x1874574690027264:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 11785us (13498us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787733985.097735:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000020:00080000:0.0:1787733985.097738:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787733985.101514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.101566:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690027520 00000100:00100000:0.0:1787733985.101577:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690027520 00000100:00100000:0.0:1787733985.101631:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:0.0:1787733985.101641:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:11358:x1874574690027520:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733985.101662:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733985.101684:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5fdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1963b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.101743:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5fdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1963b expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.101757:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5fdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1963b expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.101777:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733985.101780:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787733985.101784:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658800, rc 0) 00000100:00100000:0.0:1787733985.101841:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+33:11358:x1874574690027520:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 201us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733985.101848:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:1.0:1787733985.109829:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733985.110028:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690027776 00000100:00100000:2.0:1787733985.110052:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690027776 00000100:00100000:2.0:1787733985.110125:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1787733985.110136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+33:11358:x1874574690027776:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787733985.110806:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:11358:x1874574690027776:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 669us (984us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787733985.110815:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:1.0:1787733985.194365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733985.202432:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690028032 00000100:00100000:2.0:1787733985.202452:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690028032 00000100:00100000:2.0:1787733985.202519:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:2.0:1787733985.202529:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:11368:x1874574690028032:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733985.202554:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733985.202579:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5fe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19642 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733985.203064:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787733985.203335:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5fe3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19642 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.203351:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0dfc800) 00010000:00010000:2.0:1787733985.203355:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787733985.203361:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d5fe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19642 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.203376:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:2.0:1787733985.203496:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:11368:x1874574690028032:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 968us (9140us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787733985.203504:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:0.0:1787733985.206531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733985.206970:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690028160 00000100:00100000:2.0:1787733985.206981:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690028160 00000100:00100000:2.0:1787733985.207131:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00100000:2.0:1787733985.207143:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:11368:x1874574690028160:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:3.0:1787733985.207490:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5ff1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207508:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5ff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207521:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5ff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207537:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5ff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207544:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207550:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207755:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207771:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207778:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787733985.207818:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207829:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5ff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207835:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5ff1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207841:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5ff1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207847:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733985.207851:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5ff1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207859:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5ff1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207870:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:3.0:1787733985.207873:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733985.207877:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5ff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207883:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d5ff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207903:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207909:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5ff8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207915:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207920:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ed600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733985.207922:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207928:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207937:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec6634100) 00010000:00010000:3.0:1787733985.207939:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733985.207942:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5ff8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207948:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d5ff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207964:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207970:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207976:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207986:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733985.207990:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.207996:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.208004:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787733985.208006:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733985.208009:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.208015:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d5fff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733985.208140:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:11368:x1874574690028160:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 999us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733985.208149:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00100000:1.0:1787733985.211031:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.211143:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690028416 00000100:00100000:0.0:1787733985.211364:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690028416 00000100:00100000:0.0:1787733985.211453:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1787733985.211464:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:11368:x1874574690028416:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787733985.211753:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+36:11368:x1874574690028416:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 290us (729us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787733985.211761:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:1.0:1787733985.248960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.249071:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690028672 00000100:00100000:0.0:1787733985.249094:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690028672 00000100:00100000:0.0:1787733985.249184:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 151 00000100:00100000:0.0:1787733985.249204:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+36:11371:x1874574690028672:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733985.249234:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733985.249257:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19649 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249331:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d600d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249345:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d600d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249355:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d600d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249370:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249378:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249385:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249549:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249558:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249565:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733985.249573:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787733985.249661:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d600d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249668:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d600d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249674:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d600d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249680:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733985.249684:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d600d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249691:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d600d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249704:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733985.249707:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733985.249712:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d600d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249726:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d600d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249743:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249748:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249753:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249758:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733985.249761:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249767:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249775:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec6771400) 00010000:00010000:0.0:1787733985.249777:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733985.249780:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249786:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249827:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19649 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249840:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19649 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.249853:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733985.249856:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733985.249859:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658600, rc 0) 00000100:00100000:0.0:1787733985.249921:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:11371:x1874574690028672:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 719us (973us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787733985.249928:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 151 00000100:00100000:1.0:1787733985.255574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.268821:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690028800 00000100:00100000:0.0:1787733985.268836:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690028800 00000100:00100000:0.0:1787733985.269107:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 152 00000100:00100000:0.0:1787733985.269120:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:11371:x1874574690028800:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787733985.269295:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.269314:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.269326:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.269350:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.269357:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6029 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.269365:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.269371:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733985.269389:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.269398:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.269422:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733985.269425:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787733985.269430:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6029 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.269437:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733985.269735:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:11371:x1874574690028800:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 616us (14169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733985.269745:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 152 00000100:00100000:1.0:1787733985.271927:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733985.272147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690029056 00000100:00100000:3.0:1787733985.272182:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690029056 00000100:00100000:3.0:1787733985.272236:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:3.0:1787733985.272244:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:11371:x1874574690029056:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787733985.272547:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+39:11371:x1874574690029056:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 303us (628us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787733985.272554:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:1.0:1787733985.557789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.557885:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690029312 00000100:00100000:0.0:1787733985.557895:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690029312 00000100:00100000:0.0:1787733985.557961:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:0.0:1787733985.557971:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+39:11402:x1874574690029312:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1787733985.557994:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733985.558014:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6030 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19650 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.558108:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.558122:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.558149:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733985.558191:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787733985.558312:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6030 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19650 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.558329:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19650 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.558337:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733985.558340:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733985.558344:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659a00, rc 0) 00000100:00100000:0.0:1787733985.558409:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+41:11402:x1874574690029312:12345-192.168.201.34@tcp:101:cat.0 Request processed in 440us (630us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787733985.558416:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:1.0:1787733985.565878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733985.565933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733985.566080:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690029568 00000100:00100000:3.0:1787733985.566091:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690029568 00000100:00100000:3.0:1787733985.566148:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:3.0:1787733985.566191:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+41:11402:x1874574690029568:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:0.0:1787733985.566394:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690029696 00000100:00100000:0.0:1787733985.566408:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690029696 00000100:00100000:0.0:1787733985.566451:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:0.0:1787733985.566458:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+43:2356:x1874574690029696:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733985.566468:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733985.566488:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19650 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.566504:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733985.566509:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733985.567390:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+42:11402:x1874574690029568:12345-192.168.201.34@tcp:35:cat.0 Request processed in 1197us (1518us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787733985.567411:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:0.0:1787733985.569448:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+41:2356:x1874574690029696:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 2980us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733985.569462:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1787733985.650254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733985.654004:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690029952 00000100:00100000:3.0:1787733985.654018:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690029952 00000100:00100000:2.0:1787733985.654228:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:2.0:1787733985.654240:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+41:11408:x1874574690029952:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:2.0:1787733985.654264:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733985.654268:0:8190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787733985.654295:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d5f9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19626 expref: 41 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.654316:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787733985.654321:0:8190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787733985.654334:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6045 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19657 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.654455:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.654468:0:8190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19649 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.654477:0:8190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.654516:0:8190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19649 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.654529:0:8190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19649 expref: 41 pid: 5833 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733985.654548:0:8190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec75500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705759744:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733985.655120:0:8190:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733985.668254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.668363:0:8190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec75500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705759744:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733985.668392:0:8190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733985.668485:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690030080 00000100:00100000:1.0:1787733985.668493:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690030080 00010000:00010000:1.0:1787733985.668556:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19649 expref: 42 pid: 5833 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733985.668695:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1787733985.668707:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+42:2355:x1874574690030080:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733985.668723:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733985.668731:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19649 expref: 42 pid: 5833 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733985.668745:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19649 expref: 42 pid: 5833 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733985.668767:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d601b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19649 expref: 42 pid: 5833 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733985.668784:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:1.0:1787733985.668789:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733985.668816:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733985.668824:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733985.668855:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733985.668921:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+41:2355:x1874574690030080:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 215us (675us total) trans 0 rc 0/0 00010000:00010000:2.0:1787733985.668969:0:8190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.668977:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733985.668998:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787733985.669142:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6045 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19657 expref: 43 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.669189:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19657 expref: 42 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.669197:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:2.0:1787733985.669200:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787733985.669203:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030a00, rc 0) 00000100:00100000:2.0:1787733985.669228:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+42:11408:x1874574690029952:12345-192.168.201.34@tcp:101:dd.0 Request processed in 14991us (18986us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787733985.669236:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:1.0:1787733985.674786:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1787733985.678516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733985.678722:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690030336 00000100:00100000:2.0:1787733985.678733:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690030336 00000100:00100000:2.0:1787733985.678777:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 155 00000100:00100000:2.0:1787733985.678786:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+41:11408:x1874574690030336:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:2.0:1787733985.679044:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.679062:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.679089:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787733985.680753:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787733985.680806:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017f68411 reply state 00000000406f41de transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733985.680818:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787733985.685591:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+44:11408:x1874574690030336:12345-192.168.201.34@tcp:36:dd.0 Request processed in 6793us (7082us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787733985.685612:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 155 00000020:00080000:2.0:1787733985.685620:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787733985.698358:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.698386:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.698404:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.698411:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733985.698416:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.698424:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.698441:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:2.0:1787733985.698444:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733985.698464:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.698671:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d605a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.722964:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733985.867959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.868948:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690030464 00000100:00100000:0.0:1787733985.868961:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690030464 00000100:00100000:0.0:1787733985.869028:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 156 00000100:00100000:0.0:1787733985.869040:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+43:11422:x1874574690030464:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:0.0:1787733985.869065:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733985.869086:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6061 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1965e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869149:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6068 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869180:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869440:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869460:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d606f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869467:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d606f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869487:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d606f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869579:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869590:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19657 expref: 44 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869598:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869692:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19657 expref: 44 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.869706:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19657 expref: 44 pid: 8190 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733985.869722:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1874574705759872:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733985.869872:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee57e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787733985.872040:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733985.872119:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690030720 00000100:00100000:2.0:1787733985.872128:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690030720 00000100:00100000:2.0:1787733985.872218:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:2.0:1787733985.872229:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+45:5590:x1874574690030720:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787733985.872546:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:5590:x1874574690030720:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 317us (514us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787733985.872554:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:1.0:1787733985.874495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733985.874624:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690030848 00000100:00100000:3.0:1787733985.874632:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690030848 00010000:00010000:3.0:1787733985.874665:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19657 expref: 46 pid: 8190 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733985.874700:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:3.0:1787733985.874708:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:2355:x1874574690030848:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733985.874721:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733985.874728:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19657 expref: 46 pid: 8190 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.874742:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19657 expref: 46 pid: 8190 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.874764:0:11156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787733985.874770:0:11156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.874781:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.874788:0:11156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733985.874819:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733985.874874:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:2355:x1874574690030848:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 166us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733985.874882:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00010000:00010000:0.0:1787733985.875963:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d604c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19657 expref: 45 pid: 8190 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733985.875985:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1874574705759872:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733985.876008:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876017:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876031:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733985.876077:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787733985.876082:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733985.876102:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876115:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876125:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876132:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6068 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876139:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876146:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733985.876150:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876195:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6068 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876214:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733985.876217:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733985.876221:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876237:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876248:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d606f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876254:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d606f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876260:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d606f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876265:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733985.876269:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d606f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876275:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d606f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876283:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec6771400) 00010000:00010000:0.0:1787733985.876286:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733985.876289:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d606f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876295:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d606f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876572:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6061 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1965e expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876589:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1965e expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.876615:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733985.876617:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733985.876620:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659800, rc 0) 00000100:00100000:0.0:1787733985.876674:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+44:11422:x1874574690030464:12345-192.168.201.34@tcp:101:stat.0 Request processed in 7635us (8724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733985.876682:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 156 00000100:00100000:1.0:1787733985.914653:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733985.914793:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690031104 00000100:00100000:0.0:1787733985.914803:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690031104 00000100:00100000:0.0:1787733985.914863:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 157 00000100:00100000:0.0:1787733985.914874:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+44:11428:x1874574690031104:12345-192.168.201.34@tcp:36:truncate.0 00010000:00010000:0.0:1787733985.914929:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733985.914956:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1965e expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.914975:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733985.914981:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787733985.915235:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.915249:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733985.915258:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787733985.915308:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787733985.915331:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064f73283 reply state 0000000048c462ab transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733985.915462:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787733985.915549:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:11428:x1874574690031104:12345-192.168.201.34@tcp:36:truncate.0 Request processed in 676us (905us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787733985.915556:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 157 00000020:00080000:0.0:1787733985.915561:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787733985.917297:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.917312:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.917332:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.917344:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733985.917349:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.917355:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.917370:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:2.0:1787733985.917373:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733985.917388:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733985.917403:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d607d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733986.017676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733986.017768:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690031232 00000100:00100000:2.0:1787733986.017778:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690031232 00000100:00080000:3.0:1787733986.017827:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733986.017849:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:2.0:1787733986.017860:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+45:11442:x1874574690031232:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:2.0:1787733986.017884:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733986.017906:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6084 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19665 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.017974:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d608b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.017988:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d608b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018000:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d608b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018015:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018022:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018028:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018145:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018200:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018217:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733986.018251:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787733986.018256:0:8190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733986.018276:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018289:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018297:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d608b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018304:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d608b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018310:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d608b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018315:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733986.018320:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d608b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018327:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d608b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018356:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787733986.018359:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733986.018364:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d608b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018369:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d608b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018383:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018416:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6092 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018423:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018428:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733986.018431:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018437:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6092 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018444:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ee0dfca00) 00010000:00010000:2.0:1787733986.018446:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733986.018449:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6092 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018454:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018498:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19665 expref: 47 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018513:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19665 expref: 46 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.018521:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:2.0:1787733986.018523:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787733986.018526:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca800, rc 0) 00000100:00100000:2.0:1787733986.018584:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:11442:x1874574690031232:12345-192.168.201.34@tcp:101:stat.0 Request processed in 726us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733986.018592:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:1.0:1787733986.101021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733986.101140:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690031488 00000100:00100000:0.0:1787733986.101150:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690031488 00000100:00100000:0.0:1787733986.101261:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:0.0:1787733986.101273:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+46:11452:x1874574690031488:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733986.101303:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733986.101325:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1966c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733986.101446:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787733986.101566:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1966c expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.101581:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0dfc800) 00010000:00010000:0.0:1787733986.101584:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787733986.101589:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1966c expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.101604:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659800, rc 0) 00000100:00100000:0.0:1787733986.101654:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:11452:x1874574690031488:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 383us (642us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787733986.101661:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:1.0:1787733986.104537:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733986.104632:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690031744 00000100:00100000:2.0:1787733986.104643:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690031744 00000100:00100000:2.0:1787733986.104699:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1787733986.104707:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec738e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+47:11452:x1874574690031744:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733986.104936:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec738e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+48:11452:x1874574690031744:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 230us (409us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787733986.104942:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:1.0:1787733986.166541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733986.166789:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690032000 00000100:00100000:2.0:1787733986.166800:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690032000 00000100:00100000:2.0:1787733986.167230:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 160 00000100:00100000:2.0:1787733986.167243:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+48:11458:x1874574690032000:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733986.171618:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733986.171653:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19673 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.171785:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.171804:0:8190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19665 expref: 49 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.172236:0:8190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.172576:0:8190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19665 expref: 49 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.172593:0:8190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19665 expref: 49 pid: 8190 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733986.172607:0:8190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705760000:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733986.172770:0:8190:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787733986.177891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733986.177976:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690032128 00000100:00100000:0.0:1787733986.177995:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690032128 00010000:00010000:0.0:1787733986.178034:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19665 expref: 50 pid: 8190 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733986.178073:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:0.0:1787733986.178083:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:2355:x1874574690032128:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787733986.178100:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733986.178106:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19665 expref: 50 pid: 8190 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.178120:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19665 expref: 50 pid: 8190 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.178150:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733986.178193:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.178203:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.178211:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.178227:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787733986.178287:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:2355:x1874574690032128:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 200us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733986.178294:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00010000:00010000:2.0:1787733986.178792:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19665 expref: 49 pid: 8190 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733986.178809:0:8190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705760000:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733986.178831:0:8190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.178840:0:8190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.178860:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733986.178877:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787733986.179456:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19673 expref: 50 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.179473:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19673 expref: 49 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.179481:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:2.0:1787733986.179484:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787733986.179486:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca000, rc 0) 00000100:00100000:2.0:1787733986.179535:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+49:11458:x1874574690032000:12345-192.168.201.34@tcp:101:bash.0 Request processed in 12295us (13057us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787733986.179542:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 160 00000100:00100000:1.0:1787733986.183773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733986.183854:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690032384 00000100:00100000:0.0:1787733986.183874:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690032384 00000100:00100000:0.0:1787733986.183923:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 161 00000100:00100000:0.0:1787733986.183932:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+49:11458:x1874574690032384:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:0.0:1787733986.184633:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.184652:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.184662:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787733986.184719:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787733986.184747:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049907c2f reply state 00000000befaff32 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733986.184756:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787733986.184849:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:11458:x1874574690032384:12345-192.168.201.34@tcp:36:bash.0 Request processed in 915us (1084us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787733986.184856:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 161 00000020:00080000:0.0:1787733986.184861:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787733986.188095:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.188111:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.188118:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.188124:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733986.188129:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.188153:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.188211:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:2.0:1787733986.188214:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733986.188218:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.188224:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d60c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733986.192918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733986.193013:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690032512 00000100:00100000:0.0:1787733986.193023:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690032512 00000100:00100000:0.0:1787733986.193101:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 162 00000100:00100000:0.0:1787733986.193110:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+51:11458:x1874574690032512:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787733986.193139:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733986.193185:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d60ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1967a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.193310:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.193331:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19673 expref: 52 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.193339:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.193370:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19673 expref: 52 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.193383:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19673 expref: 52 pid: 8190 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733986.193406:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1874574705760128:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733986.193524:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee57e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787733986.198723:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733986.198788:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690032640 00000100:00100000:2.0:1787733986.198796:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690032640 00010000:00010000:2.0:1787733986.198846:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19673 expref: 53 pid: 8190 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733986.198884:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:2.0:1787733986.198893:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:2354:x1874574690032640:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733986.198908:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733986.198915:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19673 expref: 53 pid: 8190 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.198929:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19673 expref: 53 pid: 8190 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.198950:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:2.0:1787733986.198955:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.198980:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.198987:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.199005:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733986.199051:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:2354:x1874574690032640:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 159us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733986.199058:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00010000:00010000:3.0:1787733986.201050:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19673 expref: 52 pid: 8190 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733986.201072:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1874574705760128:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733986.201094:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733986.201102:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733986.201109:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733986.201201:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787733986.201207:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787733986.201228:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733986.201454:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d60ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1967a expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733986.201472:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1967a expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733986.201511:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787733986.201515:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787733986.201518:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659e00, rc 0) 00000100:00100000:3.0:1787733986.201587:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+51:11458:x1874574690032512:12345-192.168.201.34@tcp:101:bash.0 Request processed in 8477us (8677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733986.201595:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 162 00000100:00100000:1.0:1787733986.204730:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733986.204810:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690032896 00000100:00100000:2.0:1787733986.204827:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690032896 00000100:00100000:2.0:1787733986.204882:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:2.0:1787733986.204892:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+51:11458:x1874574690032896:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1787733986.205124:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:11458:x1874574690032896:12345-192.168.201.34@tcp:35:bash.0 Request processed in 231us (402us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787733986.205131:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1787733986.323492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733986.323592:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690033152 00000100:00100000:0.0:1787733986.323603:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690033152 00000100:00100000:0.0:1787733986.323664:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 163 00000100:00100000:0.0:1787733986.323675:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:11468:x1874574690033152:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733986.323701:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733986.323725:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d60d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19681 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733986.323855:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787733986.323971:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d60d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19681 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.323986:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0dfc800) 00010000:00010000:0.0:1787733986.324003:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787733986.324010:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d60d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19681 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.324024:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659400, rc 0) 00000100:00100000:0.0:1787733986.324086:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:11468:x1874574690033152:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 413us (604us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787733986.324094:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 163 00000100:00100000:1.0:1787733986.328046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733986.328212:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690033280 00000100:00100000:2.0:1787733986.328223:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690033280 00000100:00100000:2.0:1787733986.328528:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 164 00000100:00100000:2.0:1787733986.328540:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:11468:x1874574690033280:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1787733986.328615:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328630:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328641:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328671:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d60ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328678:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d60ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328685:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d60ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328783:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328793:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328801:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787733986.328843:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328855:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328860:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328868:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328874:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733986.328878:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328892:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328903:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787733986.328907:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733986.328912:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328918:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d60e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328932:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d60ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328938:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d60ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328943:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d60ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328948:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733986.328950:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d60ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328956:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d60ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.328963:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ee0dfca00) 00010000:00010000:2.0:1787733986.328966:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733986.328969:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d60ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.329044:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d60ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.329060:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.329067:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.329072:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.329077:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733986.329080:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.329086:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.329094:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:2.0:1787733986.329096:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733986.329099:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.329105:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d60f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733986.329524:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:11468:x1874574690033280:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 983us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733986.329532:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 164 00000100:00100000:1.0:1787733986.332496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733986.332567:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690033536 00000100:00100000:2.0:1787733986.332576:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690033536 00000100:00100000:2.0:1787733986.332631:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1787733986.332641:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+53:11468:x1874574690033536:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733986.332906:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:11468:x1874574690033536:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 266us (419us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787733986.332914:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:1.0:1787733986.385928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733986.385995:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690033792 00000100:00100000:0.0:1787733986.386005:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690033792 00000100:00100000:0.0:1787733986.386126:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 165 00000100:00100000:0.0:1787733986.386138:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:11471:x1874574690033792:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733986.386209:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733986.386232:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d60fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19688 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386331:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6102 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386345:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386356:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386370:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386377:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386409:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386536:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386545:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386552:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733986.386562:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787733986.386656:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386664:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6102 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386670:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6102 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386677:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733986.386681:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6102 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386689:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6102 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386701:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733986.386704:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733986.386715:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6102 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386722:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6102 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386736:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386743:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6109 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386760:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386766:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733986.386769:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386774:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386782:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec6771400) 00010000:00010000:0.0:1787733986.386784:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733986.386786:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6109 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386791:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386845:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d60fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19688 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386873:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19688 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.386881:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733986.386884:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733986.386886:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658400, rc 0) 00000100:00100000:0.0:1787733986.386938:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:11471:x1874574690033792:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 804us (1018us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787733986.386946:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 165 00000100:00100000:1.0:1787733986.390874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733986.391224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733986.391259:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690034048 00000100:00100000:1.0:1787733986.391269:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690034048 00000100:00100000:1.0:1787733986.391430:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1787733986.391441:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:2354:x1874574690034048:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733986.391455:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733986.391479:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19688 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733986.391499:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:1.0:1787733986.391503:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733986.391552:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:2354:x1874574690034048:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 111us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733986.391558:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1787733986.391914:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690033920 00000100:00100000:2.0:1787733986.391919:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690033920 00000100:00100000:0.0:1787733986.392054:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:0.0:1787733986.392063:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:11471:x1874574690033920:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787733986.392119:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d611e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.392132:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d611e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.392141:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d611e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.392970:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d611e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.392980:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d611e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.392987:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d611e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.393010:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733986.393014:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d611e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.393021:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d611e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.393033:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733986.393036:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787733986.393040:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d611e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.393046:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d611e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733986.393108:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:11471:x1874574690033920:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 1044us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733986.393115:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:1.0:1787733986.396428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733986.396530:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690034304 00000100:00100000:2.0:1787733986.396539:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690034304 00000100:00100000:2.0:1787733986.396628:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:2.0:1787733986.396639:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:11471:x1874574690034304:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733986.396925:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:11471:x1874574690034304:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 286us (507us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787733986.396932:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:2.0:1787733986.546302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733986.546497:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690034560 00000100:00100000:0.0:1787733986.546507:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690034560 00000100:00100000:0.0:1787733986.546570:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:0.0:1787733986.546581:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:11489:x1874574690034560:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1787733986.546603:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733986.546625:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6125 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1968f expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.546719:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d612c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.546751:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d612c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.546762:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d612c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733986.546775:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787733986.546896:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6125 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1968f expref: 59 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.546913:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d612c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1968f expref: 58 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.546922:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787733986.546925:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787733986.546929:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659400, rc 0) 00000100:00100000:0.0:1787733986.546992:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11489:x1874574690034560:12345-192.168.201.34@tcp:101:cat.0 Request processed in 413us (711us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787733986.546999:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:1.0:1787733986.569561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733986.569694:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690034688 00000100:00100000:2.0:1787733986.569704:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690034688 00000100:00100000:2.0:1787733986.569758:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:2.0:1787733986.569767:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11490:x1874574690034688:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733986.569790:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733986.569815:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d613a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19696 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.569877:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.569905:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.569916:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733986.569971:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787733986.569974:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733986.569991:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.570014:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d613a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19696 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.570032:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19696 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.570040:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787733986.570043:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787733986.570046:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca800, rc 0) 00000100:00100000:2.0:1787733986.570134:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11490:x1874574690034688:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 366us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733986.570140:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:2.0:1787733986.581796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733986.581888:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690035072 00000100:00100000:3.0:1787733986.581897:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690035072 00000100:00100000:3.0:1787733986.581950:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:3.0:1787733986.581961:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11490:x1874574690035072:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787733986.582449:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11490:x1874574690035072:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 489us (661us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787733986.582457:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:1.0:1787733986.584457:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733986.584878:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690035200 00000100:00100000:3.0:1787733986.584887:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690035200 00000100:00100000:3.0:1787733986.584946:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1787733986.584956:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef0387850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11490:x1874574690035200:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:3.0:1787733986.584970:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787733986.584993:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d60d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1967a expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733986.585012:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d612c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1968f expref: 59 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733986.585023:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d5fdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1963b expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733986.585046:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787733986.585057:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733986.585114:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef0387850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:11490:x1874574690035200:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 159us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733986.585122:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1787733986.587134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733986.587415:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690035328 00000100:00100000:0.0:1787733986.587423:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690035328 00000100:00100000:0.0:1787733986.587481:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:0.0:1787733986.587491:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:11490:x1874574690035328:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:0.0:1787733986.587590:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6148 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.587605:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6148 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733986.587635:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6148 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787733986.587964:0:8190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787733986.588510:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:11490:x1874574690035328:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 1018us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733986.588519:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:1.0:1787733986.603054:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733986.603152:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690035456 00000100:00100000:2.0:1787733986.603214:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690035456 00000100:00100000:2.0:1787733986.603268:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00100000:2.0:1787733986.603286:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:11492:x1874574690035456:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733986.603320:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733986.603339:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d614f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1969d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603410:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6156 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603424:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603434:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603450:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d615d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603456:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d615d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603462:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d615d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603556:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603565:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603572:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733986.603604:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787733986.603612:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733986.603631:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603643:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603651:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603657:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6156 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603663:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603669:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733986.603673:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603680:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6156 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603691:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787733986.603694:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733986.603698:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6156 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603704:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6156 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603716:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d615d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603733:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d615d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603738:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d615d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603743:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733986.603746:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d615d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603752:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d615d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603760:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ee0dfca00) 00010000:00010000:2.0:1787733986.603762:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733986.603765:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d615d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603771:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d615d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603803:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d614f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1969d expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603816:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1969d expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733986.603824:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771400) 00010000:00010000:2.0:1787733986.603826:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787733986.603835:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:2.0:1787733986.603895:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11492:x1874574690035456:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 618us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733986.603902:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 170 00010000:00010000:1.0:1787733986.750827:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787733987.004611:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787733987.004621:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787733987.004678:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1787733987.004685:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787733987.005045:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efed5e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705760256:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787733987.005139:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee57e7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787733987.014180:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733987.014216:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690035584 00000100:00100000:1.0:1787733987.014224:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690035584 00000100:00100000:3.0:1787733987.014597:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efed5e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705760256:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787733987.014797:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00100000:1.0:1787733987.014809:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11503:x1874574690035584:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787733987.014839:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787733987.014953:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11503:x1874574690035584:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 146us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733987.014961:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00100000:3.0:1787733987.019898:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733987.022062:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690035712 00000100:00100000:2.0:1787733987.022078:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690035712 00000100:00100000:2.0:1787733987.022145:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:2.0:1787733987.022176:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11503:x1874574690035712:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787733987.022510:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d616b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022528:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d616b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022541:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d616b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022556:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6172 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022564:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6172 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022570:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6172 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022597:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022605:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022628:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733987.022668:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787733987.022672:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733987.022684:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022696:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d616b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022703:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d616b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022710:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d616b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022715:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733987.022720:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d616b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022727:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d616b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022738:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:2.0:1787733987.022741:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733987.022746:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d616b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022752:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d616b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022775:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6172 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022781:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6172 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022788:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6172 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022794:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733987.022797:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6172 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022869:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6172 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022878:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff891ee0dfca00) 00010000:00010000:2.0:1787733987.022881:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733987.022884:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6172 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022889:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6172 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022904:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022910:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022916:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022928:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733987.022931:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022937:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022946:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771400) 00010000:00010000:2.0:1787733987.022948:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733987.022951:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.022957:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733987.023051:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11503:x1874574690035712:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 895us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733987.023060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:3.0:1787733987.030675:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733987.030712:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690035968 00000100:00100000:3.0:1787733987.030722:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690035968 00000100:00100000:3.0:1787733987.030781:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:3.0:1787733987.030792:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11503:x1874574690035968:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733987.030827:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733987.030850:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d6180 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.030951:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d6187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.030966:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d6187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.030976:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d6187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733987.030987:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787733987.031088:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d6187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.031104:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d6187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.031110:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d6187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.031116:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ed600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733987.031120:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d6187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.031128:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d6187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.031140:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771400) 00010000:00010000:3.0:1787733987.031143:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787733987.031148:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d6187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.031179:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ed600/0x45228d86de4d6187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.031226:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d6180 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196a4 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.031245:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:3.0:1787733987.031247:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787733987.031251:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec200/0x45228d86de4d6180 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196a4 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.031267:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec200, rc 0) 00000100:00100000:3.0:1787733987.031329:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11503:x1874574690035968:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 538us (664us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787733987.031337:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:1.0:1787733987.036325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733987.036569:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690036096 00000100:00100000:0.0:1787733987.036579:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690036096 00000100:00100000:0.0:1787733987.036643:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:0.0:1787733987.036654:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11503:x1874574690036096:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787733987.036688:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787733987.036792:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11503:x1874574690036096:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 140us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733987.036811:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:3.0:1787733987.039570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733987.039610:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690036352 00000100:00100000:3.0:1787733987.039619:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690036352 00000100:00100000:3.0:1787733987.039666:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:3.0:1787733987.039674:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11503:x1874574690036352:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733987.039692:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733987.039695:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787733987.039722:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19696 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.039742:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:3.0:1787733987.039747:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733987.039760:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d6195 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196ab expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787733987.041966:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787733987.042629:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d619c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.042646:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d619c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.042658:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d619c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.042722:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec600/0x45228d86de4d6195 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ab expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.042755:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d619c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ab expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.042764:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6634100) 00010000:00010000:3.0:1787733987.042766:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787733987.042770:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891efe7ec000, rc 0) 00000100:00100000:3.0:1787733987.042931:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11503:x1874574690036352:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 3256us (3369us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787733987.042940:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:0.0:1787733987.046096:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733987.046722:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690036608 00000100:00100000:2.0:1787733987.046734:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690036608 00000100:00100000:2.0:1787733987.046838:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:2.0:1787733987.046849:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11503:x1874574690036608:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787733987.046908:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733987.046935:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ec000/0x45228d86de4d619c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ab expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.046953:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6634100) 00010000:00010000:2.0:1787733987.046966:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787733987.046999:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047014:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047024:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047066:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf1440b91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047074:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf1440b91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047081:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf1440b91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047512:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047522:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047528:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047534:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733987.047538:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047545:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047563:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787733987.047565:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733987.047569:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047574:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047584:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf1440b91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047589:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf1440b91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047594:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf1440b91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047599:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733987.047601:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf1440b91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047606:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf1440b91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047612:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf1440b91 (ffff891ee0dfca00) 00010000:00010000:2.0:1787733987.047614:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733987.047617:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf1440b91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.047622:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf1440b91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733987.047757:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11503:x1874574690036608:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 908us (1671us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787733987.047766:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:1.0:1787733987.054738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733987.054837:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690036736 00000100:00100000:0.0:1787733987.054862:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690036736 00000100:00100000:0.0:1787733987.054922:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:0.0:1787733987.054933:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11503:x1874574690036736:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787733987.054953:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733987.054979:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d61b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196b2 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.055014:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.055028:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.055039:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.055130:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d61b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b2 expref: 61 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.055147:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b2 expref: 60 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.055193:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:0.0:1787733987.055197:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787733987.055200:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658600, rc 0) 00000100:00100000:0.0:1787733987.055263:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11503:x1874574690036736:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 333us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733987.055270:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:3.0:1787733987.061088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733987.061203:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690036992 00000100:00100000:1.0:1787733987.061214:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690036992 00000100:00100000:1.0:1787733987.061447:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 178 00000100:00100000:1.0:1787733987.061458:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11503:x1874574690036992:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787733987.061544:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.061560:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.061571:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787733987.061834:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787733987.061845:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 305050688316ns, next at 306050685831ns, rc = 0 00000004:00010000:1.0:1787733987.061926:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083fe196d reply state 0000000001d43074 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733987.061935:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787733987.062074:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+62:11503:x1874574690036992:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 617us (995us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787733987.062081:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 178 00010000:00010000:2.0:1787733987.064715:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.064733:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.064740:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.064746:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733987.064751:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.064759:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.064776:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:2.0:1787733987.064779:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787733987.064784:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.064790:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d61c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733987.066087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733987.066595:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690037120 00000100:00100000:0.0:1787733987.066619:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690037120 00000100:00100000:0.0:1787733987.066676:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 179 00000100:00100000:0.0:1787733987.066687:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11503:x1874574690037120:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787733987.066709:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733987.066727:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d61cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196b9 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.066784:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d61cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b9 expref: 62 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.066798:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d61cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b9 expref: 62 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.066907:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:0.0:1787733987.066910:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787733987.066914:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658e00, rc 0) 00000100:00100000:0.0:1787733987.066966:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+62:11503:x1874574690037120:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 281us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733987.066973:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 179 00000100:00100000:1.0:1787733987.070398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733987.070667:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690037248 00000100:00100000:2.0:1787733987.070676:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690037248 00000100:00100000:2.0:1787733987.070743:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1787733987.070755:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2355:x1874574690037248:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787733987.071136:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690037248:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 381us (746us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787733987.071194:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00080000:3.0:1787733987.071846:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787733987.074557:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733987.074829:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690037504 00000100:00100000:3.0:1787733987.074838:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690037504 00000100:00100000:3.0:1787733987.074893:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1787733987.074901:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+62:11503:x1874574690037504:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787733987.075114:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+63:11503:x1874574690037504:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 213us (565us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787733987.075121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:0.0:1787733987.084939:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733987.085036:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690037760 00000100:00100000:1.0:1787733987.085061:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690037760 00000100:00100000:1.0:1787733987.085126:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 180 00000100:00100000:1.0:1787733987.085138:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+63:11503:x1874574690037760:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787733987.085312:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+63:11503:x1874574690037760:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 175us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733987.085320:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 180 00000100:00100000:1.0:1787733987.091961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733987.098365:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690037888 00000100:00100000:2.0:1787733987.098393:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690037888 00000100:00100000:2.0:1787733987.098467:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:2.0:1787733987.098480:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+63:11503:x1874574690037888:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787733987.098500:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733987.098523:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.098609:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.098624:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.098636:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733987.098674:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787733987.098696:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.098726:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c0 expref: 65 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.098745:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c0 expref: 64 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.098767:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:2.0:1787733987.098770:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787733987.098774:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca000, rc 0) 00000100:00100000:2.0:1787733987.099074:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+64:11503:x1874574690037888:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 595us (7120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733987.099082:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:1.0:1787733987.108225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733987.111595:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690038016 00000100:00100000:2.0:1787733987.111610:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690038016 00000100:00100000:2.0:1787733987.111670:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1787733987.111680:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690038016:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787733987.111697:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733987.111718:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d61e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196c7 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787733987.111746:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ea7e3, blocks: 0x1 00010000:00010000:2.0:1787733987.111765:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=305s v=(0 0) 00010000:00010000:2.0:1787733987.111770:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733987.111780:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d61e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c7 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.111809:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d61e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c7 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.111823:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cbe00, rc 0) 00000100:00100000:2.0:1787733987.111896:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2354:x1874574690038016:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 217us (3680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733987.111905:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1787733987.122456:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733987.122570:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690038272 00000100:00100000:0.0:1787733987.122580:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690038272 00000100:00100000:0.0:1787733987.122637:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:0.0:1787733987.122649:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+64:11503:x1874574690038272:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787733987.122749:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+64:11503:x1874574690038272:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 103us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733987.122756:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:3.0:1787733987.129672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733987.129757:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690038400 00000100:00100000:0.0:1787733987.129766:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690038400 00000100:00100000:0.0:1787733987.129822:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:0.0:1787733987.129833:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:11503:x1874574690038400:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787733987.129851:0:6729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733987.129870:0:6729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196ce expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.129900:0:6729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d61e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c7 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.129909:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787733987.129913:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787733987.129918:0:6729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 9 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.129951:0:6729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d61e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c7 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.129964:0:6729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d61e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c7 expref: 9 pid: 6681 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733987.129978:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6729:1874574705760384:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733987.130056:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082900 going to sleep for 11 seconds 00000100:00100000:3.0:1787733987.138945:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733987.139083:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efea9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6729:1874574705760384:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733987.139125:0:6729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 9 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.139182:0:6729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658800, rc 0) 00000100:00100000:3.0:1787733987.139237:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:11503:x1874574690038400:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 9405us (9573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733987.139247:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:1.0:1787733987.141067:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690038528 00000100:00100000:1.0:1787733987.141079:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690038528 00010000:00010000:1.0:1787733987.141118:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d61e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c7 expref: 10 pid: 6681 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733987.141175:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:1.0:1787733987.141185:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:2354:x1874574690038528:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733987.141199:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733987.141220:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d61e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c7 expref: 10 pid: 6681 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.141235:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d61e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c7 expref: 10 pid: 6681 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.141270:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d61e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c7 expref: 10 pid: 6681 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.141287:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733987.141299:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733987.141309:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 9 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.141320:0:11156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 9 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.141359:0:11156:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 9 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733987.141382:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11156:1874574705760512:192.168.201.34@tcp:105: 00000100:00100000:1.0:1787733987.141452:0:11156:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efe973d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787733987.149123:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733987.149185:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690038656 00000100:00100000:3.0:1787733987.149195:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690038656 00002000:00100000:3.0:1787733987.149244:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff891ed2005180 x1874574690038656/t0(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:453/0 lens 504/0 e 0 to 0 dl 1787733998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787733987.149481:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891ed2005180 with x1874574690038656 ext(0->8) 00002000:00010000:3.0:1787733987.149487:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891ed2005180 00000100:00100000:3.0:1787733987.149515:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1787733987.149526:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2354:x1874574690038656:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787733987.150094:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+11:2354:x1874574690038656:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 568us (978us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787733987.150104:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00002000:00100000:3.0:1787733987.150111:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff891ed2005180 x1874574690038656/t4294967314(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:453/0 lens 504/448 e 0 to 0 dl 1787733998 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787733987.150121:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891ed2005180 with x1874574690038656 ext(0->8) 00002000:00010000:3.0:1787733987.150125:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891ed2005180 00000100:00100000:1.0:1787733987.153619:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11156:1874574705760512:192.168.201.34@tcp:105: 00010000:00010000:1.0:1787733987.153644:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733987.153714:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:2354:x1874574690038528:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 12528us (14778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733987.153725:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:0.0:1787733987.162473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733987.163044:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690038784 00000100:00100000:0.0:1787733987.163060:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690038784 00000100:00100000:0.0:1787733987.163115:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 183 00000100:00100000:0.0:1787733987.163125:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+64:11503:x1874574690038784:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787733987.163267:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+64:11503:x1874574690038784:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 143us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733987.163274:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 183 00000001:00080000:2.0:1787733987.174815:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000100:00100000:2.0:1787733987.174890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733987.176145:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690038912 00000100:00100000:3.0:1787733987.176175:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690038912 00000100:00100000:3.0:1787733987.176228:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:3.0:1787733987.176245:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2354:x1874574690038912:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787733987.183621:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000004:00080000:1.0:1787733987.183654:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:1.0:1787733987.183670:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1787733987.183673:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1787733987.183716:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff891ed0ba9300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787733987.183721:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891eefa32e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff891ed0ba9a80 00000020:00080000:1.0:1787733987.183724:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891eefa32300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff891eef7a6c00 00000001:00080000:1.0:1787733987.183747:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1787733987.183918:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787733987.184082:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787733987.184103:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705760640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787733987.184200:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733987.184247:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787733987.184256:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705760768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787733987.184282:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733987.184309:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705760640 00000100:00100000:1.0:1787733987.184316:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705760640 00000100:00100000:1.0:1787733987.184362:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705760768 00000100:00100000:1.0:1787733987.184365:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705760768 00000100:00100000:1.0:1787733987.184405:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787733987.184415:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3313:x1874574705760640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787733987.184445:0:12052:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1787733987.184485:0:12052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8ea7e1, atime: 0x0, ctime: 0x6a8ea7e1, blocks: 0xb 00010000:00010000:1.0:1787733987.184495:0:12052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049f769ea/0x45228d86de4d61f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.184517:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1787733987.184524:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733987.184532:0:12052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049f769ea/0x45228d86de4d61f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.184548:0:12052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049f769ea/0x45228d86de4d61f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.184558:0:12052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049f769ea/0x45228d86de4d61f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.184579:0:12052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049f769ea/0x45228d86de4d61f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.184597:0:12052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787733987.185034:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705760640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 619us (833us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787733987.185042:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787733987.185062:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787733987.185070:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705760768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787733987.185236:0:12052:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787733987.185240:0:12052:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787733987 00002000:00010000:1.0:1787733987.185243:0:12052:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787733987.185244:0:12052:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787733987 -> 1787733987 00002000:00010000:1.0:1787733987.185246:0:12052:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787733987.185277:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3311:x1874574705760768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (994us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787733987.185283:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:1.0:1787733987.185329:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891eeff2c700/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787733987.185335:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705760640:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787733987.185358:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891eeff2f800/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787733987.185362:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705760768:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1787733987.185543:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787733987.185551:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049f769ea/0x45228d86de4d61f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.185561:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787733987.185565:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f769ea/0x45228d86de4d61f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.185576:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f769ea/0x45228d86de4d61f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.185595:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049f769ea/0x45228d86de4d61f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.185603:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049f769ea/0x45228d86de4d61f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.185625:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733987.185627:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733987.185629:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787733987.188770:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787733987.188782:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787733987.212703:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1787733987.212845:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690038912:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 36595us (37952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733987.212856:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:1.0:1787733987.215396:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733987.215470:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690039168 00000100:00100000:2.0:1787733987.215479:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690039168 00000100:00100000:2.0:1787733987.215538:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 184 00000100:00100000:2.0:1787733987.215548:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:11503:x1874574690039168:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787733987.215618:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733987.215651:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d61db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196c0 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.215666:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:2.0:1787733987.215670:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787733987.215712:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.215726:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.215736:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787733987.216031:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000377ef197 reply state 00000000878308b8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733987.216061:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787733987.216204:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:11503:x1874574690039168:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 650us (807us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787733987.216211:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 184 00010000:00010000:0.0:1787733987.220500:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.220524:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.220532:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.220537:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733987.220542:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.220550:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.220566:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:0.0:1787733987.220569:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733987.220574:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.220580:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d61f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733987.220662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733987.221016:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690039296 00000100:00100000:2.0:1787733987.221026:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690039296 00000100:00100000:2.0:1787733987.221082:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1787733987.221093:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690039296:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787733987.221330:0:12052:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787733987.221334:0:12052:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787733987 -> 1787733986 00002000:00010000:2.0:1787733987.221336:0:12052:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787733985 00002000:00010000:2.0:1787733987.221339:0:12052:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787733987 -> 1787733986 00002000:00010000:2.0:1787733987.221341:0:12052:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787733987.221410:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2354:x1874574690039296:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 318us (751us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787733987.221417:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1787733987.236471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733987.237536:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690039552 00000100:00100000:0.0:1787733987.237548:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690039552 00000100:00100000:0.0:1787733987.237614:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 185 00000100:00100000:0.0:1787733987.237625:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:11503:x1874574690039552:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787733987.237693:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.237708:0:8190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b2 expref: 18 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.237731:0:8190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.237768:0:8190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b2 expref: 18 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.237782:0:8190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b2 expref: 18 pid: 8190 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733987.237906:0:8190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705760896:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733987.238009:0:8190:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5f81c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787733987.241844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733987.241963:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690039680 00000100:00100000:2.0:1787733987.241972:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690039680 00010000:00010000:2.0:1787733987.242008:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b2 expref: 19 pid: 8190 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733987.242048:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:2.0:1787733987.242057:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:2354:x1874574690039680:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733987.242069:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733987.242080:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b2 expref: 19 pid: 8190 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.242092:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b2 expref: 19 pid: 8190 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.242113:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:2.0:1787733987.242117:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.242126:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.242132:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.242149:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733987.242225:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:2354:x1874574690039680:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 168us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733987.242413:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00010000:00010000:1.0:1787733987.243636:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d61bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b2 expref: 18 pid: 8190 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733987.243656:0:8190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705760896:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733987.243678:0:8190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.243759:0:8190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.243767:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.243858:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.243866:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.243873:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.243879:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733987.243883:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.243897:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.243912:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:0.0:1787733987.243915:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787733987.243919:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.243925:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d61fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733987.244024:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+17:11503:x1874574690039552:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 6400us (7560us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787733987.244033:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 185 00000100:00100000:0.0:1787733987.247345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733987.247380:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690039808 00000100:00100000:1.0:1787733987.247391:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690039808 00000100:00100000:1.0:1787733987.247441:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:1.0:1787733987.247451:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2356:x1874574690039808:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787733987.247498:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.247518:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 8 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.247528:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733987.247533:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787733987.247538:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.247572:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 8 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.247586:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 8 pid: 6729 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733987.247609:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874574705761024:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733987.247686:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff891eef58b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787733987.250213:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733987.250298:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690039936 00000100:00100000:2.0:1787733987.250306:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690039936 00010000:00010000:2.0:1787733987.250344:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 9 pid: 6729 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733987.250390:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:2.0:1787733987.250399:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2355:x1874574690039936:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733987.250413:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733987.250435:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 9 pid: 6729 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.250455:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 9 pid: 6729 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.250478:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733987.250482:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733987.250488:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.250497:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733987.250516:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733987.250565:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2355:x1874574690039936:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 167us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733987.250572:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00010000:00010000:0.0:1787733987.251111:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001511cb1b/0x45228d86de4d61e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ce expref: 8 pid: 6729 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733987.251125:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874574705761024:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733987.251144:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.251242:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.251251:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.251287:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.251305:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.251312:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.251318:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787733987.251322:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.251330:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.251342:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.251349:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eda4b9fa/0x45228d86de4d6205 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733987.251466:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2356:x1874574690039808:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 4014us (4885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733987.251475:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:0.0:1787733987.263613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733987.263705:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690040192 00000100:00100000:3.0:1787733987.263714:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690040192 00000100:00100000:3.0:1787733987.265544:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 186 00000100:00100000:3.0:1787733987.265562:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+17:11503:x1874574690040192:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787733987.265643:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d620c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.265661:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d620c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.265674:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d620c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.265901:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.265914:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d61cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b9 expref: 18 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.265923:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.265958:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d61cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b9 expref: 18 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.265985:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d61cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b9 expref: 18 pid: 8190 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733987.266001:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705761152:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787733987.266099:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171c00 going to sleep for 11 seconds 00000040:00080000:1.0:1787733987.268028:0:12494:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733987.268038:0:12494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787733987.268095:0:12494:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1787733987.268101:0:12494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787733987.271866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733987.271947:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690040320 00000100:00100000:1.0:1787733987.271957:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690040320 00010000:00010000:1.0:1787733987.271996:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d61cd lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b9 expref: 19 pid: 8190 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733987.272035:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:1.0:1787733987.272045:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:2354:x1874574690040320:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733987.272059:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733987.272065:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d61cd lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b9 expref: 19 pid: 8190 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.272079:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d61cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b9 expref: 19 pid: 8190 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.272102:0:11156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:1.0:1787733987.272108:0:11156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.272117:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.272134:0:11156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.272174:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733987.272232:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:2354:x1874574690040320:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 187us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733987.272240:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00010000:00010000:3.0:1787733987.273495:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d61cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196b9 expref: 18 pid: 8190 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733987.273515:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705761152:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733987.273540:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.273549:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.273554:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787733987.273740:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787733987.275128:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787733987.280001:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787733987.281570:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705761280:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787733987.281645:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733987.281681:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e23480 going to sleep for 11 seconds 00000100:00100000:1.0:1787733987.282111:0:12051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705761280 00000100:00100000:1.0:1787733987.282120:0:12051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705761280 00000100:00100000:1.0:1787733987.282194:0:12051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787733987.282203:0:12051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5833:x1874574705761280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787733987.282381:0:12051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5833:x1874574705761280:12345-0@lo:1000:mdt00_001.0 Request processed in 179us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733987.282389:0:12051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787733987.282525:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705761280:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787733987.283904:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787733987.284001:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec75500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705761408:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787733987.284059:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733987.284126:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efea8f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787733987.284522:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705761408 00000100:00100000:3.0:1787733987.284530:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705761408 00000100:00100000:3.0:1787733987.284583:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787733987.284592:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874574705761408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787733987.284787:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1874574705761408:12345-0@lo:1000:mdt00_001.0 Request processed in 196us (728us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787733987.284794:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787733987.284994:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec75500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1874574705761408:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787733987.285034:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285045:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285052:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285058:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733987.285063:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285071:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285087:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:0.0:1787733987.285090:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787733987.285095:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285100:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6213 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285130:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6148 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285142:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6148 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285147:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6148 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285152:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733987.285189:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6148 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285196:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6148 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285205:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771400) 00010000:00010000:0.0:1787733987.285207:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787733987.285211:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6148 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285216:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d6148 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285780:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285805:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1969d expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285815:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285845:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1969d expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733987.285867:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1969d expref: 21 pid: 5833 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733987.285879:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705761536:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733987.285961:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef83f1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787733987.305945:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705761536:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733987.305976:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733987.309451:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733987.309728:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690040448 00000100:00100000:3.0:1787733987.309740:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690040448 00010000:00010000:3.0:1787733987.309787:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1969d expref: 22 pid: 5833 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733987.309832:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:3.0:1787733987.309843:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:2354:x1874574690040448:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733987.309857:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733987.309865:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1969d expref: 22 pid: 5833 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.309881:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1969d expref: 22 pid: 5833 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.309901:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1969d expref: 22 pid: 5833 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.309918:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771400) 00010000:00010000:3.0:1787733987.309923:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.309933:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.309940:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.309974:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733987.310022:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:2354:x1874574690040448:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 182us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733987.310029:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00010000:00010000:3.0:1787733987.310119:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310127:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310138:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310145:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310151:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310187:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733987.310191:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310199:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310208:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771400) 00010000:00010000:3.0:1787733987.310210:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733987.310214:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310229:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d621a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310241:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d620c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310401:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d620c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310409:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d620c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310414:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733987.310417:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d620c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310423:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d620c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310431:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771400) 00010000:00010000:3.0:1787733987.310433:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787733987.310436:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d620c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.310442:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d620c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733987.310992:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:11503:x1874574690040192:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 45433us (47384us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787733987.311002:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 186 00000020:00080000:3.0:1787733987.311012:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787733987.311125:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787733987.311130:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787733987.313191:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787733987.313208:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787733987.318289:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733987.318364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690040704 00000100:00100000:3.0:1787733987.318385:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690040704 00000100:00100000:3.0:1787733987.318446:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:3.0:1787733987.318457:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec738c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:11503:x1874574690040704:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787733987.319108:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787733987.319243:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787733987.319300:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.319316:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.319328:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.319337:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.319344:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.319349:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733987.319725:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787733987.319830:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec738c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:11503:x1874574690040704:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 1372us (1548us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787733987.319847:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000020:00080000:3.0:1787733987.319852:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787733987.320416:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787733987.320423:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.320430:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1e00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787733987.320434:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.320442:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.320455:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff891ec6634500) 00010000:00010000:1.0:1787733987.320465:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787733987.320469:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.320474:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6221 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733987.320493:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733987.320495:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733987.320497:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733987.772004:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733987.957798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733987.959253:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690040832 00000100:00100000:1.0:1787733987.959267:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690040832 00000100:00100000:1.0:1787733987.959342:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 285 00000100:00100000:1.0:1787733987.959354:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574690040832:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733987.959453:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2355:x1874574690040832:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 102us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733987.959461:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 285 00000100:00100000:3.0:1787733987.962733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733987.962915:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690040960 00000100:00100000:2.0:1787733987.962924:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690040960 00000100:00100000:2.0:1787733987.962988:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:2.0:1787733987.962998:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:2355:x1874574690040960:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733987.963098:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:2355:x1874574690040960:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 101us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733987.963106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:2.0:1787733987.966560:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733987.967324:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690041088 00000100:00100000:1.0:1787733987.967336:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690041088 00000100:00100000:1.0:1787733987.967409:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:1.0:1787733987.967420:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690041088:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787733987.967572:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690041088:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 146us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733987.967581:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:1.0:1787733987.977773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733987.977912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733987.978691:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690041216 00000100:00100000:3.0:1787733987.978702:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690041216 00000100:00100000:3.0:1787733987.978783:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:3.0:1787733987.978794:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574690041216:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733987.978880:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574690041216:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 87us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733987.978887:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00080000:1.0:1787733987.979068:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787733987.982720:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690041344 00000100:00100000:0.0:1787733987.982737:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690041344 00000100:00100000:0.0:1787733987.982828:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:0.0:1787733987.982840:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574690041344:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733987.982945:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574690041344:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 108us (5033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733987.982954:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00080000:1.0:1787733987.983207:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733988.154423:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705761920:0@lo:400:kworker.0 00000100:00100000:1.0:1787733988.154491:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733988.154560:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787733988.154573:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705761792:0@lo:400:kworker.0 00000100:00100000:1.0:1787733988.154595:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733988.154617:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705762304:0@lo:400:kworker.0 00000100:00100000:1.0:1787733988.154639:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733988.154670:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705761920 00000100:00100000:1.0:1787733988.154677:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705761920 00000100:00100000:1.0:1787733988.154722:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705761792 00000100:00100000:1.0:1787733988.154726:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705761792 00000100:00100000:1.0:1787733988.154748:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787733988.154757:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705761920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733988.154806:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705761920:12345-0@lo:400:kworker.0 Request processed in 51us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733988.154813:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787733988.154829:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787733988.154835:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705761792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733988.154862:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705761792:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733988.154868:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1787733988.154884:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733988.154912:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705761792:0@lo:400:kworker.0 00000100:00100000:1.0:1787733988.154923:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705761920:0@lo:400:kworker.0 00000100:00100000:0.0:1787733988.155045:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705762048:0@lo:400:kworker.0 00000100:00100000:0.0:1787733988.155073:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733988.155103:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787733988.155108:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705761664:0@lo:400:kworker.0 00000100:00100000:0.0:1787733988.155133:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733988.155173:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705762176:0@lo:400:kworker.0 00000100:00100000:0.0:1787733988.155194:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733988.155216:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705762304 00000100:00100000:0.0:1787733988.155219:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705762304 00000100:00100000:0.0:1787733988.155242:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705762048 00000100:00100000:0.0:1787733988.155244:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705762048 00000100:00100000:0.0:1787733988.155260:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787733988.155277:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705762304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733988.155309:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705762304:12345-0@lo:400:kworker.0 Request processed in 33us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733988.155314:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787733988.155326:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787733988.155332:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1874574705762048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733988.155372:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1874574705762048:12345-0@lo:400:kworker.0 Request processed in 40us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733988.155378:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787733988.155393:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705761664 00000100:00100000:0.0:1787733988.155397:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705761664 00000100:00100000:0.0:1787733988.155419:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787733988.155424:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705761664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787733988.155450:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705761664:12345-0@lo:400:kworker.0 Request processed in 26us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733988.155455:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787733988.155457:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705762176 00000100:00100000:2.0:1787733988.155460:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705762176 00000100:00100000:0.0:1787733988.155482:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705761664:0@lo:400:kworker.0 00000100:00100000:0.0:1787733988.155493:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705762048:0@lo:400:kworker.0 00000100:00100000:2.0:1787733988.155499:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787733988.155505:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705762176:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787733988.155535:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733988.155540:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705762176:12345-0@lo:400:kworker.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733988.155547:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787733988.155553:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705762176:0@lo:400:kworker.0 00000100:00100000:1.0:1787733988.155719:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705762304:0@lo:400:kworker.0 00000100:00100000:3.0:1787733988.667300:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787733988.667330:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705762432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787733988.667516:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733988.668684:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705762432 00000100:00100000:3.0:1787733988.668692:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705762432 00000100:00100000:3.0:1787733988.668761:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787733988.668771:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874574705762432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787733988.668806:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733988.668870:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874574705762432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733988.668879:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787733988.668923:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705762432:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787733988.794732:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733989.179025:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787733989.179051:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705762560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787733989.179122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733989.179742:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705762560 00000100:00100000:3.0:1787733989.179750:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705762560 00000100:00100000:3.0:1787733989.179823:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787733989.179835:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874574705762560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787733989.179869:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733989.179941:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874574705762560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733989.179948:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787733989.179997:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705762560:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787733989.180105:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787733989.346039:0:12546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733989.346049:0:12546:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787733989.346091:0:12546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1787733989.346097:0:12546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787733989.462001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733989.462068:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690041600 00000100:00100000:0.0:1787733989.462088:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690041600 00000100:00100000:0.0:1787733989.462186:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00100000:0.0:1787733989.462200:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:11522:x1874574690041600:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733989.462230:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733989.462251:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196d5 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.462511:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d622f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.462524:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d622f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.462536:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d622f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733989.462547:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787733989.462717:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196d5 expref: 25 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.462735:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d622f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196d5 expref: 24 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.462744:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733989.462747:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787733989.462751:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659e00, rc 0) 00000100:00100000:0.0:1787733989.462823:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:11522:x1874574690041600:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 627us (831us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787733989.462830:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00080000:1.0:1787733989.464307:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787733989.465699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733989.465787:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690041728 00000100:00100000:1.0:1787733989.465796:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690041728 00000100:00100000:1.0:1787733989.465850:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:1.0:1787733989.465859:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:11522:x1874574690041728:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:1.0:1787733989.465931:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d623d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.465946:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d623d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.465956:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d623d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.465969:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.465975:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.465980:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466309:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466318:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466326:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733989.466372:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466384:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d623d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466391:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d623d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466397:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d623d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466403:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733989.466407:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d623d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466414:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d623d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466426:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:1.0:1787733989.466430:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733989.466434:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d623d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466447:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d623d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466463:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466469:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466475:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466479:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cca00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733989.466482:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466487:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466494:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec28efa00) 00010000:00010000:1.0:1787733989.466497:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733989.466500:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466504:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466519:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466525:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466537:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466542:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733989.466545:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466551:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466559:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec28eff00) 00010000:00010000:1.0:1787733989.466562:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733989.466564:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.466570:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc400/0x45228d86de4d624b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733989.466642:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:11522:x1874574690041728:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 784us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733989.466651:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:1.0:1787733989.546036:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733989.546148:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690041984 00000100:00100000:0.0:1787733989.546590:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690041984 00000100:00100000:0.0:1787733989.546685:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:0.0:1787733989.546707:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+24:11525:x1874574690041984:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733989.546726:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733989.546747:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196dc expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.546836:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6259 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.546851:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6259 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.546863:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6259 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.546879:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.546887:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.546893:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547269:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547278:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547285:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733989.547306:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787733989.547411:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6259 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547418:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6259 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547424:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547430:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733989.547434:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547440:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6259 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547452:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733989.547455:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733989.547460:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6259 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547466:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6259 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547477:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547482:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6260 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547497:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547502:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733989.547505:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547510:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6260 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547518:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec6771300) 00010000:00010000:0.0:1787733989.547521:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733989.547523:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6260 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547528:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547568:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196dc expref: 27 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547581:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196dc expref: 26 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.547589:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:0.0:1787733989.547591:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733989.547593:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659200, rc 0) 00000100:00100000:0.0:1787733989.547718:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:11525:x1874574690041984:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1014us (1691us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787733989.547735:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:1.0:1787733989.551120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733989.551345:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690042112 00000100:00100000:2.0:1787733989.551354:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690042112 00000100:00100000:2.0:1787733989.551400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:2.0:1787733989.551409:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:11525:x1874574690042112:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1787733989.551475:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6275 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.551491:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.551502:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.551528:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.551535:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6275 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.551555:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.551561:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733989.551565:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.551573:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6275 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.551585:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:2.0:1787733989.551588:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787733989.551592:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6275 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.551598:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733989.551659:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:11525:x1874574690042112:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 250us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733989.551667:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:1.0:1787733989.553451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733989.553547:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690042368 00000100:00100000:2.0:1787733989.553553:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690042368 00000100:00100000:2.0:1787733989.553602:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1787733989.553612:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:11525:x1874574690042368:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787733989.553818:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:11525:x1874574690042368:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 207us (372us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787733989.553825:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:1.0:1787733989.579626:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733989.579731:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690042624 00000100:00100000:3.0:1787733989.579742:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690042624 00000100:00100000:3.0:1787733989.579860:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:3.0:1787733989.579873:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:11051:x1874574690042624:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787733989.579898:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733989.579922:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d627c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.580028:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.580044:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196dc expref: 28 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.580053:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.580088:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196dc expref: 28 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.580102:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196dc expref: 28 pid: 8190 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733989.580136:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1874574705762688:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787733989.580266:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787733989.582613:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1874574705762688:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733989.582642:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733989.582992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733989.583067:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690042752 00000100:00100000:3.0:1787733989.583074:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690042752 00010000:00010000:3.0:1787733989.583105:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196dc expref: 29 pid: 8190 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733989.583256:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:3.0:1787733989.583268:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:2354:x1874574690042752:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733989.583381:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733989.583390:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196dc expref: 29 pid: 8190 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.583403:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196dc expref: 29 pid: 8190 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.583424:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196dc expref: 29 pid: 8190 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.583440:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:3.0:1787733989.583445:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.583470:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.583477:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.583513:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733989.583571:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:2354:x1874574690042752:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 305us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733989.583579:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00010000:00010000:0.0:1787733989.583636:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.583644:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733989.583663:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787733989.583819:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d627c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196e3 expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.583837:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196e3 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.583844:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:0.0:1787733989.583847:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787733989.583849:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c0000, rc 0) 00000100:00100000:0.0:1787733989.583875:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:11051:x1874574690042624:12345-192.168.201.34@tcp:101:bash.0 Request processed in 4006us (4259us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787733989.583882:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:1.0:1787733989.585754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733989.585835:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690043008 00000100:00100000:2.0:1787733989.585844:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690043008 00000100:00100000:2.0:1787733989.585891:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 192 00000100:00100000:2.0:1787733989.585900:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:11051:x1874574690043008:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1787733989.586134:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.586318:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.586342:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787733989.586400:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787733989.586428:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d30dcac reply state 00000000988f118d transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733989.586437:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787733989.586485:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787733989.586621:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:11051:x1874574690043008:12345-192.168.201.34@tcp:36:bash.0 Request processed in 722us (873us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787733989.586628:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 192 00000020:00080000:2.0:1787733989.586633:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787733989.588070:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.588082:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.588089:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.588108:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733989.588113:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.588120:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.588135:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:2.0:1787733989.588138:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733989.588342:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.588350:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6291 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733989.590087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733989.590639:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690043136 00000100:00100000:0.0:1787733989.590649:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690043136 00000100:00100000:0.0:1787733989.590736:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:0.0:1787733989.590747:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+31:11051:x1874574690043136:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787733989.590777:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733989.590798:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6298 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196ea expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.590873:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6298 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ea expref: 32 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.590887:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6298 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ea expref: 32 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.590905:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:0.0:1787733989.590908:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787733989.590912:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659400, rc 0) 00000100:00100000:0.0:1787733989.591011:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:11051:x1874574690043136:12345-192.168.201.34@tcp:101:bash.0 Request processed in 265us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733989.591018:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:1.0:1787733989.593529:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733989.593622:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690043264 00000100:00100000:2.0:1787733989.593632:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690043264 00000100:00100000:2.0:1787733989.593737:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:2.0:1787733989.593747:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:11051:x1874574690043264:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733989.593774:0:6729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733989.593797:0:6729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d629f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787733989.593825:0:6729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8ea7e2, atime: 0x6a8ea7e1, ctime: 0x6a8ea7e2, blocks: 0xb 00010000:00010000:2.0:1787733989.593847:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1787733989.593852:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733989.593861:0:6729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d629f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f1 expref: 8 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.593901:0:6729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d629f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f1 expref: 8 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.593915:0:6729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13ca000, rc 0) 00000100:00100000:2.0:1787733989.593975:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:11051:x1874574690043264:12345-192.168.201.34@tcp:101:bash.0 Request processed in 229us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733989.593983:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00080000:3.0:1787733989.594034:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787733989.595876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733989.595964:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690043392 00000100:00100000:2.0:1787733989.595972:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690043392 00002000:00010000:2.0:1787733989.596012:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787733989.596017:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891ef61f6a00 with x1874574690043392 ext(0->18446744073709551615) 00002000:00010000:2.0:1787733989.596027:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891ef61f6a00. 00000100:00100000:2.0:1787733989.596058:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1787733989.596067:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2355:x1874574690043392:12345-192.168.201.34@tcp:10:bash.0 00002000:00010000:2.0:1787733989.596410:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787733989.596414:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787733986 -> 1787733990 00002000:00010000:2.0:1787733989.596417:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787733985 -> 1787733985 00002000:00010000:2.0:1787733989.596419:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787733986 -> 1787733990 00002000:00010000:2.0:1787733989.596421:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787733989.596566:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2355:x1874574690043392:12345-192.168.201.34@tcp:10:bash.0 Request processed in 499us (698us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787733989.596574:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00002000:00010000:2.0:1787733989.596578:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787733989.596580:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891ef61f6a00 with x1874574690043392 ext(0->18446744073709551615) 00002000:00010000:2.0:1787733989.596592:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891ef61f6a00. 00000100:00100000:1.0:1787733989.667517:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733989.667612:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690043520 00000100:00100000:2.0:1787733989.667623:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690043520 00000100:00100000:2.0:1787733989.667682:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:2.0:1787733989.667693:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:11539:x1874574690043520:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1787733989.667782:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d62a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.667799:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d62a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.667810:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d62a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.667826:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d62ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.667834:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d62ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.667841:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d62ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668195:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668206:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668213:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787733989.668264:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668276:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d62a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668282:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d62a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668289:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d62a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668294:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733989.668299:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d62a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668306:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d62a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668320:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787733989.668323:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733989.668336:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d62a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668341:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d62a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668354:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d62ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668360:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d62ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668375:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d62ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668380:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733989.668382:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d62ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668388:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d62ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668396:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ee0dfce00) 00010000:00010000:2.0:1787733989.668398:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733989.668400:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d62ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668405:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d62ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668419:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668424:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668429:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668433:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733989.668436:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668449:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668457:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:2.0:1787733989.668459:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733989.668462:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.668468:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733989.668549:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:11539:x1874574690043520:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 857us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733989.668557:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:1.0:1787733989.704130:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733989.704420:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690043776 00000100:00100000:3.0:1787733989.704431:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690043776 00000100:00100000:3.0:1787733989.704488:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:3.0:1787733989.704498:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+32:11542:x1874574690043776:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733989.704518:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733989.704540:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d62bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196f8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.704611:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d62c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.704626:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d62c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.704637:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d62c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.704652:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d62c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.704674:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d62c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.704681:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d62c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705026:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d62d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705036:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d62d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705044:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d62d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733989.705053:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787733989.705181:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d62c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705190:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d62c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705197:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d62c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705203:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733989.705207:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d62c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705215:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d62c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705239:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:3.0:1787733989.705241:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733989.705246:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d62c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705252:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d62c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705265:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d62c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705272:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d62c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705278:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d62c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705553:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733989.705557:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d62c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705564:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d62c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705574:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec6634600) 00010000:00010000:3.0:1787733989.705576:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733989.705579:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d62c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705586:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d62c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705640:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d62bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f8 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705654:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d62d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f8 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.705661:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:3.0:1787733989.705664:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787733989.705666:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1a00, rc 0) 00000100:00100000:3.0:1787733989.705735:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:11542:x1874574690043776:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1238us (1626us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787733989.705743:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:1.0:1787733989.709357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733989.709448:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690043904 00000100:00100000:2.0:1787733989.709457:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690043904 00000100:00100000:2.0:1787733989.709507:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:2.0:1787733989.709516:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:11542:x1874574690043904:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1787733989.709578:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.709593:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196e3 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.709602:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.709631:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196e3 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.709662:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196e3 expref: 34 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733989.709676:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705762816:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733989.709765:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efea8f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787733989.712602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733989.712692:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690044160 00000100:00100000:0.0:1787733989.712703:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690044160 00000100:00100000:0.0:1787733989.712773:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1787733989.712784:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:5590:x1874574690044160:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787733989.713124:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+36:5590:x1874574690044160:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 338us (527us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787733989.713131:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1787733989.713702:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705762816:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733989.713728:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733989.715464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733989.715634:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690044288 00000100:00100000:2.0:1787733989.715642:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690044288 00010000:00010000:2.0:1787733989.715678:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196e3 expref: 36 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733989.715718:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:2.0:1787733989.715728:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef0384450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+36:2354:x1874574690044288:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733989.715743:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733989.715750:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196e3 expref: 36 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.715775:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196e3 expref: 36 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.715796:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6283 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196e3 expref: 36 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.715832:0:11156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:2.0:1787733989.715837:0:11156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.715847:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.715854:0:11156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733989.716011:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733989.716069:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef0384450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:2354:x1874574690044288:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 342us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733989.716076:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00010000:00010000:1.0:1787733989.717070:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.717083:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.717115:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.717123:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.717130:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.717136:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733989.717149:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.717179:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.717193:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:1.0:1787733989.717196:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787733989.717200:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.717223:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d62de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733989.717299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:11542:x1874574690043904:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 7781us (7949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733989.717308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:1.0:1787733989.720100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733989.720224:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690044544 00000100:00100000:0.0:1787733989.720234:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690044544 00000100:00100000:0.0:1787733989.720301:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:0.0:1787733989.720312:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+34:11542:x1874574690044544:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787733989.720551:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:11542:x1874574690044544:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 239us (459us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787733989.720570:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1787733989.789929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733989.790001:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690044800 00000100:00100000:0.0:1787733989.790010:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690044800 00000100:00100000:0.0:1787733989.790062:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 197 00000100:00100000:0.0:1787733989.790069:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+35:11553:x1874574690044800:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1787733989.790088:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733989.790106:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d62e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df196ff expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790203:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d62ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790219:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d62ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790230:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d62ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790248:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d62f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790255:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d62f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790262:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d62f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790549:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d62fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790564:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d62fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790569:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d62fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733989.790576:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787733989.790644:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d62ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790649:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d62ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790653:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d62ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790659:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733989.790663:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d62ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790671:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d62ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790682:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733989.790685:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733989.790690:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d62ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790697:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d62ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790711:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d62f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790721:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d62f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790724:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d62f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790727:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733989.790729:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d62f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790733:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d62f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790738:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec6771300) 00010000:00010000:0.0:1787733989.790740:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733989.790741:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d62f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790744:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d62f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790782:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d62e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ff expref: 38 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790796:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d62fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ff expref: 37 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.790804:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:0.0:1787733989.790807:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733989.790813:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658600, rc 0) 00000100:00100000:0.0:1787733989.790942:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+37:11553:x1874574690044800:12345-192.168.201.34@tcp:101:cat.0 Request processed in 873us (1023us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787733989.790948:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 197 00000100:00100000:1.0:1787733989.795909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733989.796088:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690045056 00000100:00100000:0.0:1787733989.796099:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690045056 00000100:00100000:0.0:1787733989.796592:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:0.0:1787733989.796605:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+37:11553:x1874574690045056:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:0.0:1787733989.796834:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:11553:x1874574690045056:12345-192.168.201.34@tcp:35:cat.0 Request processed in 233us (938us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787733989.796840:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:1.0:1787733989.814820:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733989.815070:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690045312 00000100:00100000:3.0:1787733989.815081:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690045312 00000100:00100000:1.0:1787733989.815461:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 198 00000100:00100000:1.0:1787733989.815474:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:11554:x1874574690045312:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:1.0:1787733989.815534:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787733989.815562:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d62fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ff expref: 38 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.815585:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d62d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f8 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.815598:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6298 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196ea expref: 36 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.815608:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec6771700) 00010000:00010000:1.0:1787733989.815619:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733989.815640:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6308 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.815652:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6308 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.815675:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6308 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.815692:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.815700:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.815707:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.816012:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d6316 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.816021:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d6316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.816028:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d6316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787733989.817000:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1787733989.817012:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307805855724ns, next at 308805853084ns, rc = 0 00010000:00010000:1.0:1787733989.817076:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817086:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817095:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817112:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817118:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817124:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817381:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787733989.817404:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d6316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817411:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d6316 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817417:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d6316 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817422:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733989.817427:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d6316 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817435:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d6316 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817447:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec28efa00) 00010000:00010000:1.0:1787733989.817450:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787733989.817455:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d6316 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817471:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd600/0x45228d86de4d6316 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817491:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6308 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817496:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6308 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817502:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6308 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817506:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733989.817508:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6308 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817514:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6308 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817522:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:1.0:1787733989.817524:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733989.817527:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6308 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.817532:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6308 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787733989.817545:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ec1dfe8 reply state 00000000a514ad2d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733989.817553:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787733989.817655:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+37:11554:x1874574690045312:12345-192.168.201.34@tcp:36:rm.0 Request processed in 2180us (2840us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787733989.817664:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 198 00010000:00010000:0.0:1787733989.818999:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787733989.819010:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.819020:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787733989.819024:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.819031:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.819046:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff891ec28efa00) 00010000:00010000:0.0:1787733989.819049:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787733989.819052:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.819058:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc800/0x45228d86de4d631d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.819351:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733989.819355:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733989.819357:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787733989.820115:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733989.820815:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.820828:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.820834:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.820840:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cce00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733989.820845:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.820852:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.820868:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec28eff00) 00010000:00010000:0.0:1787733989.820871:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733989.820875:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733989.820882:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d630f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733989.851448:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733989.851530:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690045568 00000100:00100000:3.0:1787733989.851540:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690045568 00000100:00100000:3.0:1787733989.851602:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:3.0:1787733989.851613:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+36:11560:x1874574690045568:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787733989.851636:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733989.851659:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6324 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19706 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.851788:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d632b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.851804:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d632b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.851835:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d632b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.851852:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.851859:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.851864:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787733989.852480:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787733989.852646:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852656:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852664:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852702:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d632b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852710:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d632b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852717:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d632b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852723:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733989.852733:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d632b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852741:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d632b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852754:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:3.0:1787733989.852757:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733989.852763:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d632b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852769:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d632b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787733989.852782:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d0b56ad reply state 00000000c39aff0d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733989.852791:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787733989.852820:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6324 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19706 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852834:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19706 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.852840:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6634900) 00010000:00010000:3.0:1787733989.852842:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787733989.852845:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1e00, rc 0) 00000100:00100000:3.0:1787733989.852917:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+39:11560:x1874574690045568:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1305us (1478us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787733989.852925:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:2.0:1787733989.855897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733989.856118:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690045696 00000100:00100000:3.0:1787733989.856128:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690045696 00000100:00080000:0.0:1787733989.856300:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787733989.856420:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1787733989.856430:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574690045696:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787733989.856446:0:12052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733989.856466:0:12052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6f1d9a2/0x45228d86de4d6347 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1970d expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787733989.856493:0:12052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787733989.856512:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1787733989.856517:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733989.856526:0:12052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6f1d9a2/0x45228d86de4d6347 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1970d expref: 6 pid: 12052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.856545:0:12052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6f1d9a2/0x45228d86de4d6347 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1970d expref: 6 pid: 12052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.856558:0:12052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1c00, rc 0) 00000100:00100000:3.0:1787733989.856617:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2356:x1874574690045696:12345-192.168.201.34@tcp:101:bash.0 Request processed in 189us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733989.856624:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00010000:00010000:1.0:1787733989.857566:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.857578:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.857585:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.857590:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733989.857595:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.857602:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.857617:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec6634600) 00010000:00010000:1.0:1787733989.857621:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787733989.857626:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.857632:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6332 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733989.859687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733989.859798:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690045824 00000100:00100000:3.0:1787733989.859806:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690045824 00000100:00100000:3.0:1787733989.859906:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1787733989.859917:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:11560:x1874574690045824:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787733989.859935:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733989.859961:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19714 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.859994:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6f1d9a2/0x45228d86de4d6347 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1970d expref: 7 pid: 12052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.860003:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733989.860006:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733989.860012:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.860049:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6f1d9a2/0x45228d86de4d6347 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1970d expref: 7 pid: 12052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.860063:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6f1d9a2/0x45228d86de4d6347 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1970d expref: 7 pid: 12052 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733989.860077:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874574705762944:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787733989.860196:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787733989.862761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733989.862879:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874574705762944:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733989.862912:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.862932:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1000, rc 0) 00000100:00100000:3.0:1787733989.862995:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:11560:x1874574690045824:12345-192.168.201.34@tcp:101:bash.0 Request processed in 3080us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733989.863020:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1787733989.864234:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690045952 00000100:00100000:1.0:1787733989.864244:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690045952 00010000:00010000:1.0:1787733989.864278:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6f1d9a2/0x45228d86de4d6347 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1970d expref: 7 pid: 12052 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733989.864334:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:1.0:1787733989.864344:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690045952:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733989.864358:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733989.864381:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6f1d9a2/0x45228d86de4d6347 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1970d expref: 7 pid: 12052 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.864394:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6f1d9a2/0x45228d86de4d6347 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1970d expref: 7 pid: 12052 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.864417:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6f1d9a2/0x45228d86de4d6347 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1970d expref: 7 pid: 12052 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.864431:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733989.864435:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733989.864443:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.864453:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733989.864503:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733989.864517:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5819:1874574705763072:192.168.201.34@tcp:105: 00000100:00100000:1.0:1787733989.864595:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff891eef58b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787733989.867207:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5819:1874574705763072:192.168.201.34@tcp:105: 00010000:00010000:1.0:1787733989.867231:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733989.867333:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574690045952:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 2982us (4583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733989.867344:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:3.0:1787733989.869850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733989.869925:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690046208 00000100:00100000:1.0:1787733989.869934:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690046208 00000100:00100000:1.0:1787733989.869990:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:1.0:1787733989.870000:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+38:11560:x1874574690046208:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1787733989.870411:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+39:11560:x1874574690046208:12345-192.168.201.34@tcp:35:bash.0 Request processed in 411us (569us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787733989.870419:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:2.0:1787733989.993778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733989.993849:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690046336 00000100:00100000:3.0:1787733989.993858:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690046336 00000100:00100000:3.0:1787733989.993907:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:3.0:1787733989.993915:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+39:11576:x1874574690046336:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733989.993937:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733989.993954:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d6355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1971b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.994007:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d635c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.994018:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d635c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.994025:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d635c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733989.994075:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787733989.994077:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787733989.994092:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d635c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.994109:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d6355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1971b expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.994127:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d635c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1971b expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.994208:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:3.0:1787733989.994212:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787733989.994214:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1c00, rc 0) 00000100:00100000:3.0:1787733989.994268:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+40:11576:x1874574690046336:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 353us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733989.994275:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:2.0:1787733989.998043:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733989.998939:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690046592 00000100:00100000:3.0:1787733989.998948:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690046592 00000100:00100000:3.0:1787733989.999000:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00100000:3.0:1787733989.999011:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+40:11576:x1874574690046592:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733989.999033:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733989.999054:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6363 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19722 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.999145:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d636a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.999185:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d636a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.999195:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d636a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733989.999205:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787733989.999349:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6363 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19722 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.999389:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d636a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19722 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733989.999397:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6634900) 00010000:00010000:3.0:1787733989.999400:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787733989.999403:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1a00, rc 0) 00000100:00100000:3.0:1787733989.999454:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+42:11576:x1874574690046592:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 445us (1422us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787733989.999459:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00100000:0.0:1787733990.003577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.003655:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690046720 00000100:00100000:3.0:1787733990.003665:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690046720 00000100:00100000:3.0:1787733990.003732:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1787733990.003743:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+42:2356:x1874574690046720:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733990.003832:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733990.003857:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d636a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19722 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.003876:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6634900) 00010000:00010000:3.0:1787733990.003880:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733990.003942:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+41:2356:x1874574690046720:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 200us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.003950:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1787733990.006534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.006607:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690046976 00000100:00100000:3.0:1787733990.006616:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690046976 00000100:00100000:3.0:1787733990.006721:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:3.0:1787733990.006745:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+41:11576:x1874574690046976:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733990.006782:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733990.006802:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6378 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19729 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.006915:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d637f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.006929:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d637f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.006940:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d637f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733990.006952:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787733990.007074:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6378 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19729 expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.007091:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d637f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19729 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.007100:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6634900) 00010000:00010000:3.0:1787733990.007103:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787733990.007106:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1400, rc 0) 00000100:00100000:3.0:1787733990.007304:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+43:11576:x1874574690046976:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 560us (777us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787733990.007312:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:0.0:1787733990.011640:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.011720:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690047104 00000100:00100000:2.0:1787733990.011730:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690047104 00000100:00100000:2.0:1787733990.011797:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:2.0:1787733990.011808:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+6:2354:x1874574690047104:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:2.0:1787733990.011852:0:6729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.011872:0:6729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.011896:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733990.011901:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733990.011906:0:6729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.011943:0:6729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.011958:0:6729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 6 pid: 6679 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.011972:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6c7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6729:1874574705763200:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733990.012074:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efea8fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787733990.014437:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6c7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6729:1874574705763200:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787733990.014463:0:6729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733990.015331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.015463:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690047232 00000100:00100000:3.0:1787733990.015473:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690047232 00002000:00100000:3.0:1787733990.015535:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff891ef6185180 x1874574690047232/t0(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:456/0 lens 504/0 e 0 to 0 dl 1787734001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787733990.015546:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891ef6185180 with x1874574690047232 ext(0->8) 00010000:00010000:3.0:1787733990.015553:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 7 pid: 6679 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.015569:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 7 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787733990.015576:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff891ef6185180 00000100:00100000:3.0:1787733990.015612:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1787733990.015624:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690047232:12345-192.168.201.34@tcp:4:lfs.0 00000100:00100000:3.0:1787733990.016113:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2354:x1874574690047232:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 490us (794us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787733990.016122:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00002000:00100000:3.0:1787733990.016129:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff891ef6185180 x1874574690047232/t4294967308(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:456/0 lens 504/448 e 0 to 0 dl 1787734001 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787733990.016137:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891ef6185180 with x1874574690047232 ext(0->8) 00010000:00010000:3.0:1787733990.016143:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 9 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.016182:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 9 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787733990.016191:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff891ef6185180 00000100:00100000:0.0:1787733990.018830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.018921:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690047360 00000100:00100000:2.0:1787733990.018929:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690047360 00010000:00010000:2.0:1787733990.018965:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 9 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.019007:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:2.0:1787733990.019016:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2354:x1874574690047360:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733990.019038:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787733990.019054:0:11156:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787733990.019057:0:11156:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787733990 00002000:00010000:2.0:1787733990.019059:0:11156:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787733990 00002000:00010000:2.0:1787733990.019061:0:11156:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787733990 00010000:00010000:2.0:1787733990.019067:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 9 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.019079:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 9 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.019102:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9e2e31b/0x45228d86de4d634e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19714 expref: 9 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.019118:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1787733990.019123:0:11156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 1) 00010000:00010000:2.0:1787733990.019129:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.019148:0:11156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.019208:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733990.019252:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2354:x1874574690047360:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 237us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733990.019259:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00010000:00010000:3.0:1787733990.019341:0:6729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.019350:0:6729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.019373:0:6729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.019381:0:6729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.019388:0:6729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.019394:0:6729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787733990.019398:0:6729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.019406:0:6729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.019417:0:6729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.019424:0:6729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0642144/0x45228d86de4d638d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.019485:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690047104:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 7679us (7855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.019493:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1787733990.021555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.021628:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690047616 00000100:00100000:3.0:1787733990.021635:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690047616 00000100:00100000:3.0:1787733990.021686:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1787733990.021696:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec738c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+43:11576:x1874574690047616:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:3.0:1787733990.021758:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d637f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19729 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787733990.022009:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787733990.022057:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787733990.022447:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787733990.022507:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.022521:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19706 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.022529:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.022562:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19706 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.022576:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19706 expref: 47 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.022608:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1874574705763328:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787733990.022684:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787733990.025758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.025825:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690047744 00000100:00100000:2.0:1787733990.025834:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690047744 00010000:00010000:2.0:1787733990.025873:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19706 expref: 48 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.025915:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:2.0:1787733990.025926:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+48:2354:x1874574690047744:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733990.025943:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733990.025951:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19706 expref: 48 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.025964:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19706 expref: 48 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.025985:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6634900) 00010000:00010000:2.0:1787733990.025991:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.026000:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.026007:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.026026:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733990.026086:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+48:2354:x1874574690047744:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 160us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733990.026093:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00010000:00010000:3.0:1787733990.026666:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19706 expref: 47 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.026683:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1874574705763328:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733990.026703:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.026711:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.026715:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787733990.026834:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787733990.026981:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787733990.027059:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705763456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787733990.027095:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733990.027309:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec7e786c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787733990.028858:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705763456 00000100:00100000:2.0:1787733990.028886:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705763456 00000100:00100000:2.0:1787733990.028965:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787733990.028975:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1874574705763456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787733990.029169:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1874574705763456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 180us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733990.029177:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787733990.029249:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787733990.029713:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705763456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787733990.030597:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787733990.030681:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705763584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787733990.030729:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733990.030861:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff891eef58bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787733990.031014:0:12051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705763584 00000100:00100000:3.0:1787733990.031020:0:12051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705763584 00000100:00100000:3.0:1787733990.031104:0:12051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787733990.031114:0:12051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5835:x1874574705763584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787733990.031550:0:12051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:5835:x1874574705763584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 437us (820us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787733990.031568:0:12051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787733990.031639:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1874574705763584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787733990.031692:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787733990.031732:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.031743:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.031762:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.031769:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733990.031774:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.031782:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.031800:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6634900) 00010000:00010000:1.0:1787733990.031803:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787733990.031809:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.031814:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6394 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787733990.031995:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787733990.032109:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787733990.032121:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308020964891ns, next at 309020962494ns, rc = 0 00000001:00080000:1.0:1787733990.032128:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787733990.032219:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6634900) 00010000:00010000:1.0:1787733990.032232:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787733990.032239:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d637f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19729 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733990.032353:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec738c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:11576:x1874574690047616:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 10657us (10803us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787733990.032361:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000020:00080000:1.0:1787733990.032365:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787733990.034731:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.034825:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690047872 00000100:00100000:0.0:1787733990.034835:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690047872 00000100:00100000:0.0:1787733990.034892:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 203 00000100:00100000:0.0:1787733990.034902:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+50:11576:x1874574690047872:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733990.034926:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733990.034950:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d639b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19730 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.035007:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d639b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19730 expref: 51 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.035020:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d639b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19730 expref: 51 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.035039:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:0.0:1787733990.035042:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787733990.035046:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658800, rc 0) 00000100:00100000:0.0:1787733990.035103:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+51:11576:x1874574690047872:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 202us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733990.035110:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 203 00000100:00100000:1.0:1787733990.044069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.044292:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690048128 00000100:00100000:0.0:1787733990.044302:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690048128 00000100:00100000:0.0:1787733990.044380:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:0.0:1787733990.044393:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+51:11576:x1874574690048128:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787733990.044742:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:11576:x1874574690048128:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 351us (683us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787733990.044775:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1787733990.106717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.106833:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690048256 00000100:00100000:2.0:1787733990.106843:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690048256 00000100:00100000:2.0:1787733990.106901:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:2.0:1787733990.106912:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:11586:x1874574690048256:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1787733990.106993:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107010:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107021:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107036:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d63a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107043:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d63a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107050:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d63a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107192:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107215:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107222:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787733990.107263:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107276:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107283:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107289:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107295:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733990.107299:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107307:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107348:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787733990.107353:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733990.107358:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107364:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107385:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d63a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107391:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d63a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107397:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d63a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107403:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733990.107406:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d63a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107411:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d63a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107419:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ee0dfce00) 00010000:00010000:2.0:1787733990.107421:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733990.107424:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d63a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107429:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d63a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107443:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107448:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107453:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107465:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733990.107468:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107474:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107481:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:2.0:1787733990.107483:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733990.107486:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.107491:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.107565:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:11586:x1874574690048256:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 655us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733990.107573:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:2.0:1787733990.139629:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.139694:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690048512 00000100:00100000:0.0:1787733990.139703:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690048512 00000100:00100000:0.0:1787733990.139755:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 205 00000100:00100000:0.0:1787733990.139765:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+52:11589:x1874574690048512:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733990.139782:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733990.139801:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d63b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19737 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.139869:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d63be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.139883:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d63be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.139894:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d63be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.139908:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d63c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.139915:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d63c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.139921:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d63c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140043:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140067:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140074:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733990.140084:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787733990.140219:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d63be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140226:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d63be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140232:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d63be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140238:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733990.140242:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d63be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140249:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d63be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140261:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733990.140264:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733990.140268:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d63be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140274:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d63be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140287:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d63c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140298:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d63c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140305:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d63c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140309:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733990.140312:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d63c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140327:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d63c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140335:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec6771200) 00010000:00010000:0.0:1787733990.140337:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733990.140340:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d63c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140345:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d63c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140381:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d63b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19737 expref: 55 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140394:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19737 expref: 54 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.140401:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:0.0:1787733990.140403:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733990.140410:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658000, rc 0) 00000100:00100000:0.0:1787733990.140468:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:11589:x1874574690048512:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 703us (848us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787733990.140475:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 205 00000100:00100000:1.0:1787733990.143112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.143358:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690048640 00000100:00100000:2.0:1787733990.143367:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690048640 00000100:00100000:2.0:1787733990.143423:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:2.0:1787733990.143433:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:11589:x1874574690048640:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1787733990.143499:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.143514:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.143542:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.143565:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.143572:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.143578:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.143584:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733990.143588:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.143595:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.143606:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:2.0:1787733990.143609:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787733990.143614:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.143620:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.143692:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:11589:x1874574690048640:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 260us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733990.143701:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:1.0:1787733990.145937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.146022:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690048896 00000100:00100000:0.0:1787733990.146030:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690048896 00000100:00100000:0.0:1787733990.146082:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:0.0:1787733990.146094:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+54:11589:x1874574690048896:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787733990.146373:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:11589:x1874574690048896:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 280us (443us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787733990.146380:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1787733990.220122:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.220196:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690049152 00000100:00100000:3.0:1787733990.220206:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690049152 00000100:00100000:3.0:1787733990.220258:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 207 00000100:00100000:3.0:1787733990.220268:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:11599:x1874574690049152:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787733990.220407:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733990.220411:0:8190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787733990.220438:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d635c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1971b expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.220457:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:3.0:1787733990.220461:0:8190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733990.220475:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d63e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1973e expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.220569:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.220583:0:8190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19737 expref: 55 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.220592:0:8190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.220624:0:8190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19737 expref: 55 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.220655:0:8190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19737 expref: 55 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.220670:0:8190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705763712:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787733990.220875:0:8190:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee57e7300 going to sleep for 11 seconds 00000100:00100000:3.0:1787733990.223329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.223361:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690049280 00000100:00100000:3.0:1787733990.223369:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690049280 00010000:00010000:3.0:1787733990.223404:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19737 expref: 56 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.223437:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:3.0:1787733990.223447:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:2355:x1874574690049280:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733990.223461:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733990.223467:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19737 expref: 56 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.223481:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19737 expref: 56 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.223502:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:3.0:1787733990.223508:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.223517:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.223538:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.223556:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733990.223598:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+56:2355:x1874574690049280:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 152us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.223605:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00010000:00010000:3.0:1787733990.223647:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d63cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19737 expref: 55 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.223661:0:8190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705763712:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733990.223680:0:8190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.223688:0:8190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.223693:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733990.223709:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787733990.223856:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d63e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1973e expref: 56 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.223873:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1973e expref: 55 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.223881:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:3.0:1787733990.223890:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787733990.223893:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1a00, rc 0) 00000100:00100000:3.0:1787733990.223915:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:11599:x1874574690049152:12345-192.168.201.34@tcp:101:bash.0 Request processed in 3649us (3804us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787733990.223921:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 207 00000100:00100000:1.0:1787733990.229526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.233264:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690049536 00000100:00100000:2.0:1787733990.233288:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690049536 00000100:00100000:2.0:1787733990.233393:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:2.0:1787733990.233404:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+55:11599:x1874574690049536:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1787733990.233630:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.233647:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.233659:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787733990.233701:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787733990.233722:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000da9b375 reply state 0000000009bf0840 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.233731:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787733990.233821:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11599:x1874574690049536:12345-192.168.201.34@tcp:36:bash.0 Request processed in 419us (4303us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787733990.233829:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 208 00000020:00080000:2.0:1787733990.233833:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787733990.238861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.238894:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690049664 00000100:00100000:2.0:1787733990.238903:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690049664 00000100:00100000:2.0:1787733990.238953:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:2.0:1787733990.238964:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11599:x1874574690049664:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787733990.238991:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733990.239015:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19745 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.239124:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.239140:0:8190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1973e expref: 59 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.239148:0:8190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.239180:0:8190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.239198:0:8190:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.239225:0:8190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1973e expref: 59 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.239240:0:8190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1973e expref: 59 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.239254:0:8190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705763840:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733990.239339:0:8190:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efea8f900 going to sleep for 11 seconds 00010000:00010000:3.0:1787733990.239604:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.239613:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.239618:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.239625:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733990.239628:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.239636:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.239651:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:3.0:1787733990.239654:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733990.239657:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.239667:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.239674:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d63f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733990.242697:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.242794:0:8190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc5f88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705763840:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733990.242819:0:8190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.242878:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690049792 00000100:00100000:2.0:1787733990.242885:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690049792 00010000:00010000:2.0:1787733990.242920:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1973e expref: 59 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.242973:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:2.0:1787733990.242984:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:2355:x1874574690049792:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733990.242998:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733990.243005:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1973e expref: 59 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.243017:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1973e expref: 59 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.243037:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d63e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1973e expref: 59 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.243051:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:2.0:1787733990.243056:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.243064:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.243071:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.243109:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787733990.243143:0:8190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.243150:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.243175:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:2355:x1874574690049792:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 173us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733990.243182:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000004:00200000:0.0:1787733990.243211:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787733990.243215:0:8190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733990.243720:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.244103:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d63fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19745 expref: 58 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.244121:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19745 expref: 57 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.244130:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:0.0:1787733990.244140:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733990.244142:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:0.0:1787733990.244197:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:11599:x1874574690049664:12345-192.168.201.34@tcp:101:bash.0 Request processed in 5234us (5347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733990.244205:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:2.0:1787733990.247493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.247733:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690050048 00000100:00100000:0.0:1787733990.247741:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690050048 00000100:00100000:0.0:1787733990.247807:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:0.0:1787733990.247819:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+57:11599:x1874574690050048:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:0.0:1787733990.248069:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11599:x1874574690050048:12345-192.168.201.34@tcp:35:bash.0 Request processed in 251us (584us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787733990.248077:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000001:00080000:0.0:1787733990.252214:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1787733990.252245:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1787733990.252251:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1787733990.290455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.290564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690050176 00000100:00100000:0.0:1787733990.290575:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690050176 00000100:00100000:0.0:1787733990.290637:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:0.0:1787733990.290649:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+58:11605:x1874574690050176:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787733990.290674:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787733990.290695:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d640b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1974c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.290776:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.290789:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.290815:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733990.290871:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787733990.290875:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733990.290897:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.290921:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659800/0x45228d86de4d640b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1974c expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.290939:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1974c expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.290947:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733990.290950:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787733990.290954:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658e00, rc 0) 00000100:00100000:0.0:1787733990.291016:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11605:x1874574690050176:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 369us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733990.291023:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:2.0:1787733990.294011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.294069:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690050304 00000100:00100000:3.0:1787733990.294088:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690050304 00000100:00100000:3.0:1787733990.294147:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:3.0:1787733990.294189:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11605:x1874574690050304:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733990.294207:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733990.294226:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19753 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294293:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6420 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294306:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294325:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294339:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294346:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294352:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294452:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294461:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294468:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733990.294498:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787733990.294502:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787733990.294518:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294529:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294537:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294543:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6420 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294550:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294556:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733990.294560:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294567:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6420 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294587:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:3.0:1787733990.294591:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733990.294596:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6420 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294602:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6420 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294614:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294621:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294627:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294631:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733990.294634:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294639:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294646:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ec6634f00) 00010000:00010000:3.0:1787733990.294649:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733990.294652:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6427 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294657:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d6427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294700:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19753 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294714:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19753 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.294720:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:3.0:1787733990.294723:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787733990.294725:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1a00, rc 0) 00000100:00100000:3.0:1787733990.294786:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11605:x1874574690050304:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 631us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.294794:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:2.0:1787733990.298007:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733990.298088:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690050560 00000100:00100000:1.0:1787733990.298098:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690050560 00000100:00100000:1.0:1787733990.298147:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:1.0:1787733990.298185:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11605:x1874574690050560:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787733990.298201:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733990.298219:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1975a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.298332:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.298346:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19745 expref: 61 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.298371:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19753 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.298379:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.298412:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19753 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.298426:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19753 expref: 61 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733990.298440:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705763968:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733990.298527:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19745 expref: 61 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.298536:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19745 expref: 61 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733990.298545:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705764096:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733990.298571:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787733990.301385:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705763968:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733990.303305:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.303388:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690050688 00000100:00100000:3.0:1787733990.303398:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690050688 00010000:00010000:3.0:1787733990.303436:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19753 expref: 62 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.303478:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:3.0:1787733990.303487:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef0385050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+62:2354:x1874574690050688:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733990.303502:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733990.303509:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19753 expref: 62 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.303523:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19753 expref: 62 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.303560:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d642e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19753 expref: 62 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.303576:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:3.0:1787733990.303580:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.303588:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.303593:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733990.303648:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef0385050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:2354:x1874574690050688:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 162us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.303657:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:1.0:1787733990.303931:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705764096:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733990.303956:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.307629:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.307794:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690050816 00000100:00100000:3.0:1787733990.307802:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690050816 00010000:00010000:3.0:1787733990.307834:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19745 expref: 61 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.307864:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:3.0:1787733990.307870:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:2355:x1874574690050816:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733990.307881:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733990.307886:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19745 expref: 61 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.307895:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19745 expref: 61 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.307923:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031800/0x45228d86de4d6404 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19745 expref: 61 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.307934:0:11156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:3.0:1787733990.307938:0:11156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.307945:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.307949:0:11156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.307970:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787733990.308010:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.308018:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.308027:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:2355:x1874574690050816:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 156us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.308033:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00000004:00200000:1.0:1787733990.308037:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787733990.308962:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc200/0x45228d86de4d6435 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1975a expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.308984:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1975a expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.308992:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:1.0:1787733990.308995:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787733990.308997:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cce00, rc 0) 00000100:00100000:1.0:1787733990.309086:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11605:x1874574690050560:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 10930us (11086us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787733990.309094:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:2.0:1787733990.313879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.314038:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690051072 00000100:00100000:3.0:1787733990.314049:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690051072 00000100:00100000:3.0:1787733990.314488:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1787733990.314500:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11605:x1874574690051072:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:3.0:1787733990.314516:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733990.314540:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658800/0x45228d86de4d639b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19730 expref: 60 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.314558:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:3.0:1787733990.314563:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733990.314635:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11605:x1874574690051072:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 136us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.314643:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1787733990.316521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.316603:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690051200 00000100:00100000:3.0:1787733990.316610:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690051200 00000100:00100000:3.0:1787733990.316687:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:3.0:1787733990.316696:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11605:x1874574690051200:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:3.0:1787733990.316814:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.316829:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.316839:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787733990.317025:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787733990.317327:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11605:x1874574690051200:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 630us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.317335:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:0.0:1787733990.319037:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.319252:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690051328 00000100:00100000:3.0:1787733990.319259:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690051328 00000100:00100000:3.0:1787733990.319396:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 214 00000100:00100000:3.0:1787733990.319405:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+59:11605:x1874574690051328:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787733990.319420:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733990.319437:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6451 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19761 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.319483:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.319502:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6451 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19761 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.319518:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.319530:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6451 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19761 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.319543:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:3.0:1787733990.319546:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787733990.319549:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6451 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19761 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.319556:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1e00, rc 0) 00000100:00100000:3.0:1787733990.319603:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11605:x1874574690051328:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 200us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.319610:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 214 00000040:00080000:1.0:1787733990.397147:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733990.397187:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787733990.397397:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787733990.397404:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787733990.397524:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705764224:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787733990.397627:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787733990.409343:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.409427:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690051456 00000100:00100000:3.0:1787733990.409436:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690051456 00000100:00100000:3.0:1787733990.409498:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:3.0:1787733990.409509:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11606:x1874574690051456:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787733990.409543:0:8190:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787733990.409650:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11606:x1874574690051456:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 142us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.409658:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:3.0:1787733990.411842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.412060:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690051584 00000100:00100000:0.0:1787733990.412067:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690051584 00000100:00100000:0.0:1787733990.412130:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:0.0:1787733990.412141:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11606:x1874574690051584:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787733990.412235:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6458 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412263:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6458 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412275:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6458 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412292:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d645f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412301:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d645f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412308:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d645f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412364:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412374:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412381:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733990.412421:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787733990.412425:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733990.412437:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412448:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6458 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412464:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6458 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412470:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6458 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412476:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733990.412480:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6458 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412491:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6458 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412504:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:0.0:1787733990.412507:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733990.412511:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6458 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412517:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d6458 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412530:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d645f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412536:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d645f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412546:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d645f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412552:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733990.412562:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d645f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412569:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d645f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412576:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff891ec6771e00) 00010000:00010000:0.0:1787733990.412579:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733990.412581:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d645f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412586:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d645f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412600:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412606:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412611:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412616:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733990.412618:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412624:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412631:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:0.0:1787733990.412633:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733990.412641:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.412648:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733990.412725:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11606:x1874574690051584:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 585us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733990.412733:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:1.0:1787733990.413467:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705764224:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787733990.415904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.416190:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690051840 00000100:00100000:3.0:1787733990.416200:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690051840 00000100:00100000:3.0:1787733990.416271:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:3.0:1787733990.416291:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+60:11606:x1874574690051840:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733990.416311:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733990.416340:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d646d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19768 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416440:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6474 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416454:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416464:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733990.416474:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787733990.416553:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416560:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6474 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416567:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416572:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733990.416576:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416599:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6474 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416612:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:3.0:1787733990.416615:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787733990.416618:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6474 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416625:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d6474 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416674:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d646d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19768 expref: 62 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416684:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:3.0:1787733990.416686:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787733990.416690:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d646d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19768 expref: 62 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.416699:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c0000, rc 0) 00000100:00100000:3.0:1787733990.416755:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11606:x1874574690051840:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 475us (859us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787733990.416763:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:2.0:1787733990.419510:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.419595:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690051968 00000100:00100000:0.0:1787733990.419604:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690051968 00000100:00100000:0.0:1787733990.419657:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:0.0:1787733990.419670:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11606:x1874574690051968:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787733990.419702:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787733990.419819:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11606:x1874574690051968:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 152us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733990.419827:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:0.0:1787733990.423101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.423236:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690052224 00000100:00100000:2.0:1787733990.423246:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690052224 00000100:00100000:2.0:1787733990.423296:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:2.0:1787733990.423306:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11606:x1874574690052224:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787733990.423333:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733990.423336:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787733990.423364:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1974c expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.423383:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787733990.423388:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787733990.423402:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6482 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1976f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787733990.423879:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787733990.424340:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.424355:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.424364:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.424436:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d6482 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1976f expref: 63 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.424452:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1976f expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.424460:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ee0dfce00) 00010000:00010000:2.0:1787733990.424463:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787733990.424466:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cbe00, rc 0) 00000100:00100000:2.0:1787733990.424524:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+62:11606:x1874574690052224:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1218us (1430us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787733990.424532:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:2.0:1787733990.428566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.429197:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690052480 00000100:00100000:0.0:1787733990.429208:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690052480 00000100:00100000:0.0:1787733990.429269:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:0.0:1787733990.429281:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+62:11606:x1874574690052480:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787733990.429356:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787733990.429383:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d6489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1976f expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429402:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ee0dfce00) 00010000:00010000:0.0:1787733990.429426:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787733990.429448:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429462:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429472:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429533:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d649e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x32f205bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429541:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d649e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x32f205bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429547:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d649e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x32f205bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429621:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429629:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6497 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429634:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429639:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733990.429644:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429651:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429666:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733990.429668:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733990.429672:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6497 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429677:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659400/0x45228d86de4d6497 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429686:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d649e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x32f205bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429692:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d649e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x32f205bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429697:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d649e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x32f205bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429701:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733990.429703:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d649e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x32f205bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429709:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d649e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x32f205bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429715:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x32f205bb (ffff891ec6771e00) 00010000:00010000:0.0:1787733990.429717:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733990.429719:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d649e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x32f205bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.429724:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d649e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x32f205bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733990.429956:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11606:x1874574690052480:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 676us (1398us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787733990.429964:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:0.0:1787733990.432137:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.432270:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690052608 00000100:00100000:3.0:1787733990.432278:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690052608 00000100:00100000:3.0:1787733990.432338:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:3.0:1787733990.432348:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+61:11606:x1874574690052608:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733990.432375:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733990.432397:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19776 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.432431:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.432442:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.432453:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.432536:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19776 expref: 63 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.432553:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19776 expref: 62 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.432562:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:3.0:1787733990.432564:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787733990.432567:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1c00, rc 0) 00000100:00100000:3.0:1787733990.432620:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+62:11606:x1874574690052608:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 274us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.432627:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:1.0:1787733990.447512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.447629:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690052864 00000100:00100000:0.0:1787733990.447640:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690052864 00000100:00100000:0.0:1787733990.447719:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 222 00000100:00100000:0.0:1787733990.447730:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+62:11606:x1874574690052864:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787733990.447813:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.447830:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.447842:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787733990.448093:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1787733990.448486:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e305b70 reply state 00000000e698c088 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733990.448497:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787733990.448598:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+64:11606:x1874574690052864:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 869us (1095us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787733990.448606:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 222 00010000:00010000:1.0:1787733990.451592:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.451611:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.451619:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.451626:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787733990.451631:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.451639:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.451667:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:1.0:1787733990.451671:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787733990.451676:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.451682:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659a00/0x45228d86de4d64b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733990.458928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.459204:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690052992 00000100:00100000:3.0:1787733990.459215:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690052992 00000100:00100000:3.0:1787733990.459269:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 223 00000100:00100000:3.0:1787733990.459288:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+63:11606:x1874574690052992:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733990.459335:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733990.459358:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1977d expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.459419:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1977d expref: 64 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.459434:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1977d expref: 64 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.459454:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:3.0:1787733990.459457:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787733990.459461:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c0000, rc 0) 00000100:00100000:3.0:1787733990.459527:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+64:11606:x1874574690052992:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 249us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.459533:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 223 00000100:00100000:0.0:1787733990.466436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.466530:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690053120 00000100:00100000:2.0:1787733990.466540:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690053120 00000100:00100000:2.0:1787733990.466592:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:2.0:1787733990.466604:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2354:x1874574690053120:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787733990.466907:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:2354:x1874574690053120:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 304us (480us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787733990.466915:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:0.0:1787733990.469445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.469521:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690053376 00000100:00100000:3.0:1787733990.469529:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690053376 00000100:00100000:3.0:1787733990.469576:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1787733990.469585:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+64:11606:x1874574690053376:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787733990.469800:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+65:11606:x1874574690053376:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 215us (360us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787733990.469807:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:1.0:1787733990.472858:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.473199:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690053632 00000100:00100000:3.0:1787733990.473209:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690053632 00000100:00100000:3.0:1787733990.473259:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 224 00000100:00100000:3.0:1787733990.473270:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+65:11606:x1874574690053632:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787733990.473418:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+65:11606:x1874574690053632:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 149us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.473426:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 224 00000100:00100000:2.0:1787733990.477885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.477974:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690053760 00000100:00100000:3.0:1787733990.477984:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690053760 00000100:00100000:3.0:1787733990.478042:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:3.0:1787733990.478055:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+65:11606:x1874574690053760:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733990.478086:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733990.478108:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d64c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19784 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.485148:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d64c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.485203:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d64c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.485215:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d64c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733990.485253:0:8190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733990.485272:0:8190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d64c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.485307:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1400/0x45228d86de4d64c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19784 expref: 67 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.485340:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d64c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19784 expref: 66 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.485348:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:0.0:1787733990.485352:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787733990.485355:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658400, rc 0) 00000100:00100000:0.0:1787733990.485422:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+66:11606:x1874574690053760:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 7368us (7544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733990.485431:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:2.0:1787733990.505937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.506054:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690053888 00000100:00100000:3.0:1787733990.506064:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690053888 00000100:00100000:3.0:1787733990.506139:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:3.0:1787733990.506149:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+10:2355:x1874574690053888:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733990.506188:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733990.506209:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4b28a7/0x45228d86de4d64cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1978b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787733990.506236:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ea7e7, blocks: 0x1 00010000:00010000:3.0:1787733990.506256:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1787733990.506260:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733990.506269:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4b28a7/0x45228d86de4d64cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1978b expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.506297:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb4b28a7/0x45228d86de4d64cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1978b expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.506336:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c0800, rc 0) 00000100:00100000:3.0:1787733990.506402:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+11:2355:x1874574690053888:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 254us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.506409:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:1.0:1787733990.508976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.509056:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690054144 00000100:00100000:3.0:1787733990.509066:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690054144 00000100:00100000:3.0:1787733990.509123:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 226 00000100:00100000:3.0:1787733990.509144:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+66:11606:x1874574690054144:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787733990.509284:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+66:11606:x1874574690054144:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 142us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.509292:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 226 00000100:00100000:2.0:1787733990.516258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.516415:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690054272 00000100:00100000:3.0:1787733990.516425:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690054272 00000100:00100000:3.0:1787733990.516485:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:3.0:1787733990.516495:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+11:11606:x1874574690054272:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787733990.516514:0:6729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733990.516533:0:6729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19792 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.516564:0:6729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4b28a7/0x45228d86de4d64cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1978b expref: 12 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.516573:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733990.516577:0:6729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733990.516596:0:6729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 12 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.516633:0:6729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb4b28a7/0x45228d86de4d64cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1978b expref: 12 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.516648:0:6729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb4b28a7/0x45228d86de4d64cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1978b expref: 12 pid: 6679 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.516662:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6729:1874574705764352:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787733990.516768:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee57e7840 going to sleep for 11 seconds 00000100:00100000:3.0:1787733990.518902:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6729:1874574705764352:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787733990.518939:0:6729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 12 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.518958:0:6729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1000, rc 0) 00000100:00100000:3.0:1787733990.519021:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:11606:x1874574690054272:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2525us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.519030:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1787733990.540266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.540532:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690054400 00000100:00100000:3.0:1787733990.540543:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690054400 00010000:00010000:3.0:1787733990.540585:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4b28a7/0x45228d86de4d64cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1978b expref: 12 pid: 6679 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.540631:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:3.0:1787733990.540642:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:2355:x1874574690054400:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733990.540671:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733990.540694:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb4b28a7/0x45228d86de4d64cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1978b expref: 12 pid: 6679 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.540709:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb4b28a7/0x45228d86de4d64cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1978b expref: 12 pid: 6679 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.540732:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4b28a7/0x45228d86de4d64cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1978b expref: 12 pid: 6679 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.540759:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733990.540764:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733990.540772:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 11 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.540780:0:7616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 11 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.540816:0:7616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 11 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.540831:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7616:1874574705764480:192.168.201.34@tcp:105: 00000100:00100000:3.0:1787733990.540915:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ee57e7840 going to sleep for 11 seconds 00000100:00100000:3.0:1787733990.545774:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7616:1874574705764480:192.168.201.34@tcp:105: 00010000:00010000:3.0:1787733990.545805:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733990.545882:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+11:2355:x1874574690054400:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 5240us (5626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.545893:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:3.0:1787733990.554718:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.555005:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690054528 00000100:00100000:2.0:1787733990.555015:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690054528 00002000:00100000:2.0:1787733990.555078:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff891dc7b2dc00 x1874574690054528/t0(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:456/0 lens 504/0 e 0 to 0 dl 1787734001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787733990.555089:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891dc7b2dc00 with x1874574690054528 ext(0->12) 00002000:00010000:2.0:1787733990.555094:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891dc7b2dc00 00000100:00100000:2.0:1787733990.555128:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1787733990.555138:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+11:2354:x1874574690054528:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787733990.555678:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:2354:x1874574690054528:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 538us (967us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787733990.555686:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00002000:00100000:2.0:1787733990.555693:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff891dc7b2dc00 x1874574690054528/t4294967320(0) o4->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:456/0 lens 504/448 e 0 to 0 dl 1787734001 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787733990.555702:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891dc7b2dc00 with x1874574690054528 ext(0->12) 00002000:00010000:2.0:1787733990.555707:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891dc7b2dc00 00000100:00100000:0.0:1787733990.568578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.571768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690054656 00000100:00100000:2.0:1787733990.571783:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690054656 00000100:00100000:2.0:1787733990.571847:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 227 00000100:00100000:2.0:1787733990.571858:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+66:11606:x1874574690054656:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787733990.628021:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1787733990.628080:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787733990.628105:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff891eef58b780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787733990.628110:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891efe50b500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff891eef58b240 00000020:00080000:1.0:1787733990.628137:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891efe50b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff891efe596800 00000004:00080000:1.0:1787733990.628172:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1787733990.628184:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1787733990.628205:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff891efea8fd80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787733990.628209:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891eefa32200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff891efea8f6c0 00000020:00080000:1.0:1787733990.628212:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891eefa32100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff891efe95d400 00000001:00080000:1.0:1787733990.628221:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1787733990.628263:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787733990.628487:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787733990.629027:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705764736:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787733990.629099:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733990.629402:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:11606:x1874574690054656:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 57542us (60831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.629412:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 227 00000100:00100000:3.0:1787733990.629446:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705764608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787733990.629475:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733990.629515:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705764736 00000100:00100000:3.0:1787733990.629521:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705764736 00000100:00100000:3.0:1787733990.629556:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705764608 00000100:00100000:3.0:1787733990.629559:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705764608 00000100:00100000:3.0:1787733990.629581:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787733990.629589:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef63f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705764736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787733990.629614:0:12052:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787733990.629650:0:12052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8ea7e6, atime: 0x6a8ea7e6, ctime: 0x6a8ea7e6, blocks: 0xb 00010000:00010000:3.0:1787733990.629659:0:12052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d64dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.629675:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1787733990.629680:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787733990.629687:0:12052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d64dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.629702:0:12052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d64dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.629728:0:12052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d64dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.629736:0:12052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d64dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.629769:0:12052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787733990.630217:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787733990.630228:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1874574705764608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787733990.630243:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1787733990.630259:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.630273:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d629f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f1 expref: 12 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.630289:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787733990.630292:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733990.630296:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.630333:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d629f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f1 expref: 12 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.630349:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d629f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f1 expref: 12 pid: 6729 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.630362:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874574705764864:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733990.630407:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787733990.635025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.635060:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690054784 00000100:00100000:2.0:1787733990.635068:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690054784 00010000:00010000:2.0:1787733990.635107:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d629f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f1 expref: 13 pid: 6729 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.635151:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:2.0:1787733990.635181:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:2355:x1874574690054784:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733990.635196:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733990.635202:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d629f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f1 expref: 13 pid: 6729 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.635234:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d629f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f1 expref: 13 pid: 6729 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.635258:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733990.635263:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787733990.635269:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.635290:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.635320:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733990.635371:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+13:2355:x1874574690054784:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 192us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733990.635378:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00010000:00010000:1.0:1787733990.635721:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b19a1cd/0x45228d86de4d629f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.34@tcp remote: 0xa16ea362df196f1 expref: 12 pid: 6729 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733990.635739:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874574705764864:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733990.635759:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.635769:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.635789:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.635799:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.635815:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.635840:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787733990.636439:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1874574705764608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6210us (6960us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787733990.636448:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1787733990.637071:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891ef61f0700/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787733990.637093:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705764608:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787733990.637114:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787733990.637212:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787733990.637220:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.637231:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787733990.637235:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.637245:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.637277:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.637701:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d64dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.637711:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787733990.637714:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d64dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.637722:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d64dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.637746:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d64dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.637753:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d64dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.637844:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081b118e7/0x45228d86de4d64e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.637867:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733990.637870:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733990.637872:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787733990.638115:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:3.0:1787733990.638656:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733990.638659:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787733990.638661:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733990.639034:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690054912 00000100:00100000:2.0:1787733990.639043:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690054912 00000100:00100000:2.0:1787733990.639096:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:2.0:1787733990.639106:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:2354:x1874574690054912:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787733990.640674:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef63f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3312:x1874574705764736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11078us (11566us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787733990.640688:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787733990.647103:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787733990.647117:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:1.0:1787733990.647138:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891eeff2c700, transno 4294967307 00000004:00080000:1.0:1787733990.647174:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1787733990.647191:0:3312:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff891f018f7100 x1874574705764736/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787734006 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787733990.647204:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891f018f7100/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787733990.647210:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705764736:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787733990.708062:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:2354:x1874574690054912:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 68945us (69936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.708076:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000001:00080000:2.0:1787733990.708342:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1787733990.708356:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1787733990.715529:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.715610:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690055168 00000100:00100000:3.0:1787733990.715619:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690055168 00000100:00100000:3.0:1787733990.715685:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:3.0:1787733990.715697:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:11606:x1874574690055168:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787733990.715769:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733990.716093:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d64c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19784 expref: 20 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.716115:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:3.0:1787733990.716126:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787733990.716288:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.716303:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.716342:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787733990.721613:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2774e35 reply state 000000004547a2a4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.721633:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787733990.721782:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:11606:x1874574690055168:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 6076us (6251us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787733990.721790:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 228 00010000:00010000:3.0:1787733990.724333:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.724351:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.724360:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.724367:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787733990.724372:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.724379:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.724395:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:3.0:1787733990.724399:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787733990.724404:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.724410:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d64eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.725599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.725672:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690055296 00000100:00100000:3.0:1787733990.725682:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690055296 00000100:00100000:3.0:1787733990.725753:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:3.0:1787733990.725764:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2356:x1874574690055296:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787733990.726018:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787733990.726023:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787733990 00002000:00010000:3.0:1787733990.726039:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787733990 00002000:00010000:3.0:1787733990.726041:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787733991 -> 1787733990 00002000:00010000:3.0:1787733990.726043:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787733990.726110:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2356:x1874574690055296:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 347us (517us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787733990.726125:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:1.0:1787733990.728424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733990.728730:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690055552 00000100:00100000:0.0:1787733990.728740:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690055552 00000100:00100000:0.0:1787733990.728800:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00100000:0.0:1787733990.728810:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:11606:x1874574690055552:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787733990.728875:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.728902:0:8190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19776 expref: 20 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.728912:0:8190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.728947:0:8190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19776 expref: 20 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.728961:0:8190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19776 expref: 20 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733990.728975:0:8190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705764992:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787733990.729066:0:8190:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787733990.734100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.734356:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690055680 00000100:00100000:3.0:1787733990.734367:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690055680 00010000:00010000:3.0:1787733990.734408:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19776 expref: 21 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.734445:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:3.0:1787733990.734455:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:2355:x1874574690055680:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733990.734469:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733990.734475:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19776 expref: 21 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.734488:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19776 expref: 21 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.734508:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:3.0:1787733990.734513:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.734522:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.734530:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.734563:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733990.734621:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:2355:x1874574690055680:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 166us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.734628:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00010000:00010000:0.0:1787733990.737322:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1c00/0x45228d86de4d64ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19776 expref: 20 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733990.737351:0:8190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8190:1874574705764992:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733990.737376:0:8190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.737387:0:8190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.737393:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.737422:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.737446:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.737453:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.737459:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733990.737463:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.737471:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.737487:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:0.0:1787733990.737490:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787733990.737494:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.737500:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d64f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733990.737591:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:11606:x1874574690055552:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 8782us (9173us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787733990.737601:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00100000:2.0:1787733990.754300:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733990.754449:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690055808 00000100:00100000:1.0:1787733990.754460:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690055808 00000100:00100000:1.0:1787733990.754523:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:1.0:1787733990.754533:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2355:x1874574690055808:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787733990.754581:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.754603:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 8 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.754619:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787733990.754624:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787733990.754628:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.754666:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 8 pid: 6729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.754682:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 8 pid: 6729 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733990.754696:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874574705765120:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733990.754802:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efe973000 going to sleep for 11 seconds 00000100:00100000:1.0:1787733990.757029:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874574705765120:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733990.757060:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733990.763873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.764337:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690055936 00000100:00100000:3.0:1787733990.764349:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690055936 00010000:00010000:3.0:1787733990.764393:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 9 pid: 6729 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787733990.764441:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:3.0:1787733990.764451:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+9:2354:x1874574690055936:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733990.764467:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733990.764492:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 9 pid: 6729 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.764507:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 9 pid: 6729 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.764530:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9e2e31b/0x45228d86de4d64d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19792 expref: 9 pid: 6729 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.764548:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787733990.764552:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787733990.764558:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.764585:0:7616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.764619:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733990.764687:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2354:x1874574690055936:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 237us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.764696:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00010000:00010000:1.0:1787733990.765135:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.765145:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.765213:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.765230:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.765238:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.765245:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787733990.765250:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.765260:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.765272:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.765278:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000393226eb/0x45228d86de4d64f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733990.765348:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2355:x1874574690055808:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 10817us (11070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733990.765357:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:0.0:1787733990.772375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733990.772468:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690056192 00000100:00100000:1.0:1787733990.772478:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690056192 00000100:00100000:1.0:1787733990.772546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 230 00000100:00100000:1.0:1787733990.772572:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:11606:x1874574690056192:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787733990.772652:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d6500 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.772670:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d6500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.772681:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d6500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.772914:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.772926:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1977d expref: 20 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.772933:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.772970:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1977d expref: 20 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.772985:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1977d expref: 20 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733990.772999:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705765248:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787733990.773087:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efe973000 going to sleep for 11 seconds 00000100:00100000:1.0:1787733990.786485:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705765248:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787733990.786519:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733990.787651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.787998:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690056320 00000100:00100000:2.0:1787733990.788007:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690056320 00010000:00010000:2.0:1787733990.788046:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1977d expref: 21 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.788086:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:2.0:1787733990.788097:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef0386450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:2355:x1874574690056320:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787733990.788111:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787733990.788127:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1977d expref: 21 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.788152:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1977d expref: 21 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.788226:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0000/0x45228d86de4d64ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1977d expref: 21 pid: 8190 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.788243:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:2.0:1787733990.788249:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.788258:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.788264:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.788294:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787733990.788350:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef0386450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:2355:x1874574690056320:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 254us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733990.788369:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00010000:00010000:1.0:1787733990.788503:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.788510:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787733990.788694:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787733990.788869:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787733990.788918:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787733990.789005:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1874574705765376:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787733990.789051:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733990.789089:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891dc1082900 going to sleep for 11 seconds 00000100:00100000:3.0:1787733990.789220:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705765376 00000100:00100000:3.0:1787733990.789226:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705765376 00000100:00100000:3.0:1787733990.789261:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787733990.789269:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874574705765376:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787733990.789365:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874574705765376:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.789372:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787733990.789675:0:5834:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1787733990.789681:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891eeff2f800, transno 4294967315 00000004:00080000:1.0:1787733990.789698:0:5834:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1787733990.789718:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891ef61f0700, transno 4294967321 00000100:00100000:1.0:1787733990.789726:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1874574705765376:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787733990.790199:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787733990.790260:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1874574705765504:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787733990.791038:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733990.791078:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed3edcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787733990.796696:0:12051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705765504 00000100:00100000:2.0:1787733990.796715:0:12051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705765504 00000100:00100000:2.0:1787733990.796807:0:12051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787733990.796819:0:12051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5834:x1874574705765504:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787733990.797137:0:12051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5834:x1874574705765504:12345-0@lo:1000:mdt00_002.0 Request processed in 320us (6100us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787733990.797146:0:12051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787733990.797248:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1874574705765504:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787733990.797291:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797303:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797322:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797328:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cdc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733990.797332:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797339:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797355:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:2.0:1787733990.797358:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787733990.797363:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797377:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6507 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797412:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797417:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797423:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797427:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733990.797430:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797435:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797443:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:2.0:1787733990.797446:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787733990.797453:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6451 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19761 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797464:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6451 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19761 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797473:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6451 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19761 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.797516:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6451 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19761 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.797529:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705765632:192.168.201.34@tcp:105: 00000100:00100000:2.0:1787733990.797597:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a8df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787733990.801207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.801469:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1874574705765632:192.168.201.34@tcp:105: 00010000:00010000:2.0:1787733990.801498:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801511:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d644a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801542:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d650e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801556:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d650e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801568:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d650e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801577:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d650e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801584:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d650e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801591:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d650e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801614:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733990.801619:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d650e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801626:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d650e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801639:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:2.0:1787733990.801642:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787733990.801646:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d650e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801652:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d650e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801662:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d6500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801667:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d6500 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801690:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d6500 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801697:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787733990.801700:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d6500 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801706:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d6500 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801725:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:2.0:1787733990.801727:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787733990.801730:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d6500 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.801735:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd200/0x45228d86de4d6500 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.802728:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:11606:x1874574690056192:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 30153us (30357us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787733990.802740:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 230 00000020:00080000:2.0:1787733990.802746:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787733990.803432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690056448 00000100:00100000:3.0:1787733990.803441:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690056448 00000100:00100000:3.0:1787733990.803492:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1787733990.803503:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:11605:x1874574690056448:12345-192.168.201.34@tcp:49:lfs.0 00000100:00100000:3.0:1787733990.803604:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:11605:x1874574690056448:12345-192.168.201.34@tcp:49:lfs.0 Request processed in 103us (2408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.803612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:0.0:1787733990.806765:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.806986:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690056704 00000100:00100000:3.0:1787733990.806996:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690056704 00000100:00100000:3.0:1787733990.807051:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:3.0:1787733990.807062:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec738d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+23:11606:x1874574690056704:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787733990.809468:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787733990.809649:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787733990.809717:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.809741:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.809980:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.809992:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.810000:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.810007:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733990.810066:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:1.0:1787733990.811743:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733990.811758:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787733990.812257:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787733990.812266:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787733990.819594:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787733990.819612:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.819625:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787733990.819630:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.819640:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.819660:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff891ec6634600) 00010000:00010000:0.0:1787733990.819665:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787733990.819670:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.819676:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6515 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.819708:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733990.819710:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787733990.819712:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733990.823033:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec738d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:11606:x1874574690056704:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 15960us (16284us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787733990.823049:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000020:00080000:3.0:1787733990.823057:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787733990.830370:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733990.831413:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690056960 00000100:00100000:3.0:1787733990.831425:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690056960 00000100:00100000:3.0:1787733990.831500:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 231 00000100:00100000:3.0:1787733990.831511:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:11605:x1874574690056960:12345-192.168.201.34@tcp:58:lfs.0 00000040:00080000:3.0:1787733990.832256:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787733990.832373:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:11605:x1874574690056960:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 861us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733990.832382:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 231 00010000:00010000:2.0:1787733990.842295:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733990.896499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.896601:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690057088 00000100:00100000:2.0:1787733990.896612:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690057088 00000100:00100000:2.0:1787733990.896680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 232 00000100:00100000:2.0:1787733990.896692:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+25:11608:x1874574690057088:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733990.896721:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733990.896758:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d651c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19799 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.896825:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6523 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.896840:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.896850:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.896880:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d652a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.896887:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d652a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.896894:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d652a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.897253:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.897266:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1975a expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.897275:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.897317:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1975a expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733990.897332:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1975a expref: 26 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.897346:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705765760:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787733990.897432:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a8df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787733990.905405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733990.905911:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690057344 00000100:00100000:2.0:1787733990.905921:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690057344 00000100:00100000:2.0:1787733990.905980:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:2.0:1787733990.906008:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:5590:x1874574690057344:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787733990.906278:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:5590:x1874574690057344:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 272us (882us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787733990.906295:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:0.0:1787733990.908213:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1874574705765760:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787733990.908241:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787733990.908549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733990.908628:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690057472 00000100:00100000:1.0:1787733990.908635:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690057472 00010000:00010000:1.0:1787733990.908668:0:11156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1975a expref: 28 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787733990.908714:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:1.0:1787733990.908724:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:2355:x1874574690057472:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787733990.908755:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787733990.908763:0:11156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1975a expref: 28 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.908775:0:11156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1975a expref: 28 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.908797:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cce00/0x45228d86de4d643c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1975a expref: 28 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.908817:0:11156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:1.0:1787733990.908822:0:11156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.908832:0:11156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.908840:0:11156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733990.908869:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787733990.908918:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+27:2355:x1874574690057472:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 194us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733990.908925:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00010000:00010000:0.0:1787733990.909962:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.909973:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787733990.910025:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787733990.910029:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787733990.910051:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910064:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910074:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910081:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6523 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910087:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6523 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910094:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733990.910098:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6523 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910106:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6523 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910129:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:0.0:1787733990.910133:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733990.910137:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6523 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910144:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca000/0x45228d86de4d6523 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910192:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d652a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910198:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d652a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910204:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d652a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910209:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733990.910212:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d652a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910218:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d652a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910227:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff891ee0dfc100) 00010000:00010000:0.0:1787733990.910230:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787733990.910233:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d652a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910239:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca800/0x45228d86de4d652a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910276:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbe00/0x45228d86de4d651c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19799 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910424:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19799 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733990.910441:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:0.0:1787733990.910444:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787733990.910446:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ef6b61800, rc 0) 00000100:00100000:0.0:1787733990.910496:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:11608:x1874574690057088:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 13805us (14006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733990.910505:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 232 00000040:00080000:1.0:1787733991.640021:0:12598:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733991.640034:0:12598:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787733991.640087:0:12598:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787733991.640093:0:12598:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787733991.866652:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787733991.870261:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733991.870271:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787733991.870329:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787733991.870336:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787733991.870459:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705765888:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787733991.870559:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5082180 going to sleep for 11 seconds 00000100:00100000:1.0:1787733991.873315:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874574705765888:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787733991.873846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733991.876723:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690057600 00000100:00100000:0.0:1787733991.876739:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690057600 00000100:00100000:0.0:1787733991.876834:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 233 00000100:00080000:3.0:1787733991.876836:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787733991.876862:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:11620:x1874574690057600:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787733991.876906:0:8190:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787733991.877014:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:11620:x1874574690057600:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 153us (3167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733991.877022:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 233 00000100:00100000:2.0:1787733991.881527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733991.881624:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690057856 00000100:00100000:1.0:1787733991.881634:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690057856 00000100:00100000:1.0:1787733991.881704:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 234 00000100:00100000:1.0:1787733991.881722:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+26:11620:x1874574690057856:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787733991.881742:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787733991.881764:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6538 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df197a0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733991.881870:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d653f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733991.882056:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d653f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733991.882069:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d653f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787733991.882081:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787733991.882270:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cca00/0x45228d86de4d6538 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197a0 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733991.882303:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d653f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197a0 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787733991.882313:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:1.0:1787733991.882316:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787733991.882320:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc000, rc 0) 00000100:00100000:1.0:1787733991.882375:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:11620:x1874574690057856:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 662us (856us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787733991.882382:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 234 00000100:00100000:1.0:1787733991.885895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733991.886085:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690058240 00000100:00100000:0.0:1787733991.886095:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690058240 00000100:00100000:0.0:1787733991.886195:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 235 00000100:00100000:0.0:1787733991.886216:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:11620:x1874574690058240:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787733991.886305:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d654d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733991.886323:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d654d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733991.886334:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d654d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733991.886527:0:8190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d654d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733991.886535:0:8190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d654d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733991.886542:0:8190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d654d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733991.886547:0:8190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733991.886551:0:8190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d654d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733991.886559:0:8190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d654d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733991.886570:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:0.0:1787733991.886573:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787733991.886578:0:8190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d654d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733991.886585:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d654d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733991.887115:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:11620:x1874574690058240:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 900us (1239us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787733991.887124:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 235 00000040:00080000:1.0:1787733991.889053:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787733991.889061:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787733991.889598:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787733991.889606:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787733991.891722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733991.891832:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690057984 00000100:00100000:3.0:1787733991.891842:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690057984 00000100:00100000:3.0:1787733991.891919:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1787733991.891930:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:2354:x1874574690057984:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787733991.891945:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787733991.891970:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc000/0x45228d86de4d653f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197a0 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733991.891991:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:3.0:1787733991.891996:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787733991.892057:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:2354:x1874574690057984:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 128us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733991.892065:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1787733991.897350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733991.897437:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690058496 00000100:00100000:2.0:1787733991.897447:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690058496 00000100:00100000:2.0:1787733991.897508:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:2.0:1787733991.897519:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+28:11620:x1874574690058496:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787733991.897778:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:11620:x1874574690058496:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 260us (438us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787733991.897787:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00010000:00010000:0.0:1787733992.890889:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733993.078234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733993.078280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733993.078302:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690058624 00000100:00100000:2.0:1787733993.078311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733993.078314:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690058624 00000100:00100000:2.0:1787733993.078337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733993.078375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733993.078395:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690059136 00000100:00100000:2.0:1787733993.078399:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690059136 00000100:00100000:2.0:1787733993.078444:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690058752 00000100:00100000:2.0:1787733993.078447:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690058752 00000100:00100000:2.0:1787733993.078472:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:2.0:1787733993.078481:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574690059136:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733993.078548:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2354:x1874574690059136:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 68us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733993.078570:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:2.0:1787733993.078588:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:2.0:1787733993.078595:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:2354:x1874574690058752:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733993.078607:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 287 00000100:00100000:0.0:1787733993.078619:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574690058624:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733993.078646:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574690058624:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733993.078652:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 287 00000100:00100000:2.0:1787733993.078741:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:2354:x1874574690058752:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 146us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733993.078748:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:2.0:1787733993.078768:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690058880 00000100:00100000:2.0:1787733993.078771:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690058880 00000100:00100000:2.0:1787733993.078799:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690059008 00000100:00100000:2.0:1787733993.078802:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690059008 00000100:00100000:2.0:1787733993.078827:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:0.0:1787733993.078840:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:0.0:1787733993.078850:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574690059008:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787733993.078876:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2354:x1874574690059008:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733993.078882:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:2.0:1787733993.078914:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690058880:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733993.078943:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2354:x1874574690058880:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 109us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733993.078950:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00080000:2.0:1787733993.078968:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787733993.078972:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733993.078974:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787733993.188765:0:12650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787733993.188775:0:12650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787733993.189300:0:12650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787733993.189307:0:12650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787733993.274401:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733993.274713:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705766144:0@lo:400:kworker.0 00000100:00100000:1.0:1787733993.274785:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733993.274837:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787733993.274841:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705766272:0@lo:400:kworker.0 00000100:00100000:1.0:1787733993.274860:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733993.274888:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705766144 00000100:00100000:1.0:1787733993.274894:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705766144 00000100:00100000:1.0:1787733993.274925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705766272 00000100:00100000:1.0:1787733993.274926:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705766272 00000100:00100000:1.0:1787733993.274945:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787733993.274950:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705766144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733993.274993:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705766144:12345-0@lo:400:kworker.0 Request processed in 43us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733993.274998:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787733993.275010:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787733993.275014:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705766272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733993.275029:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705766272:12345-0@lo:400:kworker.0 Request processed in 15us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733993.275032:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1787733993.275047:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733993.275077:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705766272:0@lo:400:kworker.0 00000100:00100000:1.0:1787733993.275087:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705766144:0@lo:400:kworker.0 00000100:00100000:2.0:1787733993.275332:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705766400:0@lo:400:kworker.0 00000100:00100000:2.0:1787733993.275448:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733993.275478:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705766016:0@lo:400:kworker.0 00000100:00100000:2.0:1787733993.275511:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733993.275543:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705766016 00000100:00100000:2.0:1787733993.275546:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705766016 00000100:00100000:2.0:1787733993.275570:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787733993.275575:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705766016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787733993.275603:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705766016:12345-0@lo:400:kworker.0 Request processed in 28us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733993.275608:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787733993.275638:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705766016:0@lo:400:kworker.0 00000100:00100000:1.0:1787733993.275709:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705766400 00000100:00100000:1.0:1787733993.275714:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705766400 00000100:00100000:1.0:1787733993.275752:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787733993.275759:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874574705766400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733993.275798:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874574705766400:12345-0@lo:400:kworker.0 Request processed in 40us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733993.275804:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787733993.275832:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705766400:0@lo:400:kworker.0 00000100:00080000:2.0:1787733993.275855:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787733993.277333:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705766528:0@lo:400:kworker.0 00000100:00100000:0.0:1787733993.277390:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733993.277455:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705766528 00000100:00100000:2.0:1787733993.277460:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705766528 00000100:00100000:2.0:1787733993.277505:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787733993.277513:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705766528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733993.277616:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787733993.277626:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705766656:0@lo:400:kworker.0 00000100:00100000:3.0:1787733993.277655:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733993.277694:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705766656 00000100:00100000:3.0:1787733993.277711:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705766656 00000100:00100000:3.0:1787733993.277741:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787733993.277747:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874574705766656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733993.277777:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874574705766656:12345-0@lo:400:kworker.0 Request processed in 31us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733993.277790:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787733993.277825:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705766656:0@lo:400:kworker.0 00000100:00080000:3.0:1787733993.277856:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787733993.277860:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787733993.278231:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874574705766528:12345-0@lo:400:kworker.0 Request processed in 718us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733993.278238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787733993.278444:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705766528:0@lo:400:kworker.0 00000100:00100000:0.0:1787733993.302953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733993.303006:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690059392 00000100:00100000:2.0:1787733993.303018:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690059392 00000100:00100000:2.0:1787733993.303146:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 236 00000100:00100000:2.0:1787733993.303288:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+29:11640:x1874574690059392:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787733993.303310:0:8190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733993.303331:0:8190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b60800/0x45228d86de4d6554 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df197a7 expref: -99 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733993.303424:0:8190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b60000/0x45228d86de4d655b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733993.303444:0:8190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b60000/0x45228d86de4d655b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733993.303457:0:8190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b60000/0x45228d86de4d655b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787733993.303468:0:8190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787733993.303584:0:8190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b60800/0x45228d86de4d6554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197a7 expref: 32 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733993.303600:0:8190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b60000/0x45228d86de4d655b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197a7 expref: 31 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733993.303608:0:8190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:2.0:1787733993.303611:0:8190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787733993.303614:0:8190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ef6b60000, rc 0) 00000100:00100000:2.0:1787733993.303673:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+31:11640:x1874574690059392:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 518us (725us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787733993.303681:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 236 00000100:00100000:2.0:1787733993.305885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733993.305968:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690059520 00000100:00100000:0.0:1787733993.305977:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690059520 00000100:00100000:0.0:1787733993.306023:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:0.0:1787733993.306033:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+31:11640:x1874574690059520:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787733993.306372:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733993.306389:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733993.306415:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733993.306441:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733993.306447:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6569 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733993.306454:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733993.306460:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787733993.306464:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733993.306471:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733993.306482:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:0.0:1787733993.306485:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787733993.306490:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6569 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787733993.306495:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658400/0x45228d86de4d6569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787733993.306561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+31:11640:x1874574690059520:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 529us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733993.306569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:0.0:1787733993.361283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733993.361488:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690059648 00000100:00100000:2.0:1787733993.361497:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690059648 00000100:00100000:2.0:1787733993.361541:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:2.0:1787733993.361549:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2357:x1874574690059648:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1787733993.361564:0:12052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787733993.361583:0:12052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2abce6/0x45228d86de4d6570 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df197ae expref: -99 pid: 12052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787733993.361615:0:12052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8ea7e6, atime: 0x6a8ea7e6, ctime: 0x6a8ea7e6, blocks: 0xb 00010000:00010000:2.0:1787733993.361632:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=311s v=(0 0) 00010000:00010000:2.0:1787733993.361635:0:12052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787733993.361642:0:12052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2abce6/0x45228d86de4d6570 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197ae expref: 8 pid: 12052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733993.361655:0:12052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b2abce6/0x45228d86de4d6570 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197ae expref: 8 pid: 12052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787733993.361665:0:12052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ef6b60800, rc 0) 00000100:00100000:2.0:1787733993.361756:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2357:x1874574690059648:12345-192.168.201.34@tcp:101:cat.0 Request processed in 207us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733993.361761:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:3.0:1787733993.364325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733993.364399:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690059776 00000100:00100000:0.0:1787733993.364408:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690059776 00002000:00100000:0.0:1787733993.364452:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff891dc7b2c700 x1874574690059776/t0(0) o3->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:459/0 lens 488/0 e 0 to 0 dl 1787734004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787733993.364460:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891dc7b2c700 with x1874574690059776 ext(0->4095) 00002000:00010000:0.0:1787733993.364465:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891dc7b2c700 00000100:00100000:0.0:1787733993.364494:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1787733993.364503:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2356:x1874574690059776:12345-192.168.201.34@tcp:3:cat.0 00000100:00100000:0.0:1787733993.364823:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2c26bfa-a021-441a-9db5-0c3742b5640d+8:2356:x1874574690059776:12345-192.168.201.34@tcp:3:cat.0 Request processed in 320us (508us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787733993.364832:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00002000:00100000:0.0:1787733993.364839:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff891dc7b2c700 x1874574690059776/t0(0) o3->a2c26bfa-a021-441a-9db5-0c3742b5640d@192.168.201.34@tcp:459/0 lens 488/4536 e 0 to 0 dl 1787734004 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787733993.364847:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff891dc7b2c700 with x1874574690059776 ext(0->4095) 00002000:00010000:0.0:1787733993.364851:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff891dc7b2c700 00000100:00100000:0.0:1787733993.786434:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705766784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787733993.786514:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733993.786570:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705766784 00000100:00100000:3.0:1787733993.786580:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705766784 00000100:00100000:3.0:1787733993.786633:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787733993.786643:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874574705766784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787733993.786679:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787733993.786741:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874574705766784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733993.786748:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787733993.786795:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705766784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787733993.917567:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787733994.298500:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705766912:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1787733994.298503:0:6726:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312287345978ns, next at 313287343378ns, rc = 0 00000100:00100000:3.0:1787733994.298582:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733994.298639:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705766912 00000100:00100000:2.0:1787733994.298647:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705766912 00000100:00100000:2.0:1787733994.298761:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787733994.298772:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874574705766912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787733994.298807:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733994.298860:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874574705766912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733994.298868:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787733994.298899:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705766912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787733994.939895:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787733995.386711:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787733995.881943:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:1.0:1787733995.881973:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff891ec7e786c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787733995.881978:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891efeceb500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff891ec596db40 00000020:00080000:1.0:1787733995.881982:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff891efecebb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff891dc62e0400 00000020:00080000:1.0:1787733995.882014:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787733995.882018:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000004:00080000:1.0:1787733995.882025:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:1.0:1787733995.882042:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:2.0:1787733995.882142:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefd85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705767040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787733995.882247:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733995.882319:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705767040 00000100:00100000:2.0:1787733995.882327:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705767040 00000100:00100000:2.0:1787733995.882380:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787733995.882391:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874574705767040:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1787733995.882502:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00002000:00010000:2.0:1787733995.882590:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787733995.882595:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787733990 -> 1787733990 00002000:00010000:2.0:1787733995.882598:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1787733990 -> 1787733990 00002000:00010000:2.0:1787733995.882601:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787733990 -> 1787733990 00002000:00010000:2.0:1787733995.882603:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787733995.882658:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705767040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 268us (411us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787733995.882667:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787733995.882695:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787733995.882703:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891eefd85180/2, rc 0, transno 4294967324 00000100:00100000:1.0:1787733995.882712:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefd85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705767040:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1787733995.888286:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787733995.888305:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00010000:00010000:0.0:1787733995.962328:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787733996.254276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787733996.254343:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690059904 00000100:00100000:1.0:1787733996.254354:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690059904 00000100:00080000:2.0:1787733996.254426:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733996.254434:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00100000:1.0:1787733996.254446:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:11286:x1874574690059904:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787733996.254554:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:11286:x1874574690059904:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733996.254562:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00100000:2.0:1787733996.257742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787733996.257887:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690060160 00000100:00100000:0.0:1787733996.257897:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690060160 00000100:00100000:0.0:1787733996.258009:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:0.0:1787733996.258021:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:11286:x1874574690060160:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787733996.258666:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:11286:x1874574690060160:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 645us (929us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787733996.258674:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:0.0:1787733996.419725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787733996.419812:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690060288 00000100:00100000:3.0:1787733996.419822:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690060288 00000100:00100000:3.0:1787733996.419897:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 239 00000100:00100000:3.0:1787733996.419909:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:12091:x1874574690060288:12345-192.168.201.34@tcp:101:lsof.0 00000100:00080000:2.0:1787733996.419915:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787733996.419930:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787733996.419967:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df197b5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733996.420033:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d657e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733996.420046:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d657e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733996.420060:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d657e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787733996.420302:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787733996.420307:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787733996.420391:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d657e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733996.420417:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1000/0x45228d86de4d6577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197b5 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733996.420435:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d657e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197b5 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787733996.420444:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0dfc800) 00010000:00010000:3.0:1787733996.420446:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787733996.420450:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c0800, rc 0) 00000100:00100000:3.0:1787733996.420517:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:12091:x1874574690060288:12345-192.168.201.34@tcp:101:lsof.0 Request processed in 609us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733996.420524:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 239 00010000:00010000:1.0:1787733996.986517:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787733998.011777:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733998.205483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733998.205530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733998.205567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733998.205597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733998.205626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787733998.205661:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690060416 00000100:00100000:2.0:1787733998.205678:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690060416 00000100:00100000:2.0:1787733998.205746:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 289 00000100:00100000:2.0:1787733998.205759:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2356:x1874574690060416:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787733998.205867:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2356:x1874574690060416:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 109us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733998.205875:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 289 00000100:00100000:3.0:1787733998.206202:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690060800 00000100:00100000:3.0:1787733998.206215:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690060800 00000100:00100000:3.0:1787733998.206264:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690060672 00000100:00100000:3.0:1787733998.206268:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690060672 00000100:00100000:3.0:1787733998.206351:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:3.0:1787733998.206360:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574690060800:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733998.206403:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2356:x1874574690060800:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 46us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733998.206410:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:3.0:1787733998.206423:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:3.0:1787733998.206428:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2356:x1874574690060672:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733998.206454:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2356:x1874574690060672:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733998.206460:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:3.0:1787733998.206481:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690060544 00000100:00100000:3.0:1787733998.206485:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690060544 00000100:00100000:3.0:1787733998.206513:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690060928 00000100:00100000:3.0:1787733998.206516:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690060928 00000100:00100000:3.0:1787733998.206537:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:3.0:1787733998.206543:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:2356:x1874574690060544:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733998.206582:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:2356:x1874574690060544:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 39us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733998.206590:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:3.0:1787733998.206603:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:3.0:1787733998.206609:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:2356:x1874574690060928:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787733998.206634:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:2356:x1874574690060928:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733998.206648:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00080000:2.0:1787733998.207269:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787733998.207277:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733998.207281:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1787733998.305237:0:12850:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:46:38 (1787733998) 00000100:00100000:1.0:1787733998.394535:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705767424:0@lo:400:kworker.0 00000100:00100000:1.0:1787733998.394651:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787733998.394743:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787733998.394750:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705767552:0@lo:400:kworker.0 00000100:00100000:1.0:1787733998.394784:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733998.395022:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eefd85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705767168:0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.395063:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733998.395095:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705767680:0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.395117:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733998.395136:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787733998.395140:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705767296:0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.395211:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733998.395230:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eef7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705767808:0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.395252:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787733998.395285:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705767424 00000100:00100000:3.0:1787733998.395295:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705767424 00000100:00100000:3.0:1787733998.395358:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705767680 00000100:00100000:3.0:1787733998.395361:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705767680 00000100:00100000:3.0:1787733998.395377:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705767296 00000100:00100000:3.0:1787733998.395379:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705767296 00000100:00100000:3.0:1787733998.395394:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787733998.395403:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eef78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705767424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.395468:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eef78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705767424:12345-0@lo:400:kworker.0 Request processed in 65us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733998.395476:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787733998.395498:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787733998.395504:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705767680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.395536:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874574705767680:12345-0@lo:400:kworker.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733998.395560:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787733998.395571:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787733998.395651:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705767296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.395684:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705767296:12345-0@lo:400:kworker.0 Request processed in 106us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733998.395691:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787733998.395725:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705767552 00000100:00100000:3.0:1787733998.395730:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705767552 00000100:00100000:3.0:1787733998.395759:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705767808 00000100:00100000:3.0:1787733998.395762:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705767808 00000100:00100000:3.0:1787733998.395782:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787733998.395787:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1874574705767552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.395832:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1874574705767552:12345-0@lo:400:kworker.0 Request processed in 45us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733998.395839:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787733998.395852:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787733998.395858:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705767808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.395889:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705767808:12345-0@lo:400:kworker.0 Request processed in 31us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787733998.395896:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787733998.395943:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1787733998.395950:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:3.0:1787733998.395979:0:3312:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff891eefd85180 x1874574705767040/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787734011 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787733998.395991:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705767552:0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.396014:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705767424:0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.396062:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705767296:0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.396070:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787733998.396075:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891f018f7100, transno 4294967310 00000100:00100000:3.0:1787733998.396087:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705767808:0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.396099:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eef7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874574705767680:0@lo:400:kworker.0 00000100:00080000:2.0:1787733998.396306:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787733998.396312:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787733998.396315:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787733998.397723:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705767168 00000100:00100000:1.0:1787733998.397738:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705767168 00000100:00100000:1.0:1787733998.397802:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787733998.397823:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705767168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787733998.397933:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:df19622b-ae94-4c8d-b052-574898624480+19:3310:x1874574705767168:12345-0@lo:400:kworker.0 Request processed in 112us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787733998.397941:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787733998.398633:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eefd85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705767168:0@lo:400:kworker.0 00000100:00100000:3.0:1787733998.906421:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787733998.906461:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705767936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787733998.906555:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787733998.906613:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705767936 00000100:00100000:0.0:1787733998.906624:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705767936 00000100:00100000:0.0:1787733998.906697:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787733998.906709:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705767936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787733998.906759:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787733998.906835:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705767936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787733998.906843:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787733998.906898:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705767936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787733999.035262:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787733999.422326:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705768064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787733999.422422:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787733999.422516:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705768064 00000100:00100000:2.0:1787733999.422526:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705768064 00000100:00100000:2.0:1787733999.422585:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787733999.422596:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874574705768064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787733999.422642:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787733999.422692:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874574705768064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787733999.422700:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787733999.422754:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705768064:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787734000.058622:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787734000.058634:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:2.0:1787734000.059273:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787734000.059562:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787734000.059572:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787734001.035598:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1787734001.035844:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787734001.035860:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787734001.035922:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787734001.035935:0:5865:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1787734001.086924:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787734001.580526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734001.580659:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690061184 00000100:00100000:1.0:1787734001.580671:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690061184 00000100:00100000:1.0:1787734001.580751:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:1.0:1787734001.580764:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+18:12312:x1874574690061184:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:1.0:1787734001.581424:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:12312:x1874574690061184:12345-192.168.201.34@tcp:35:umount.0 Request processed in 661us (904us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787734001.581435:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00080000:2.0:1787734001.581532:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787734001.584305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734001.584427:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690061440 00000100:00100000:2.0:1787734001.584439:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690061440 00000100:00100000:2.0:1787734001.584522:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:2.0:1787734001.584533:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+19:12312:x1874574690061440:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:2.0:1787734001.587263:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:12312:x1874574690061440:12345-192.168.201.34@tcp:35:umount.0 Request processed in 2715us (2955us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787734001.587281:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:0.0:1787734001.595420:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734001.596104:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690061696 00000100:00100000:1.0:1787734001.596129:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690061696 00000100:00100000:1.0:1787734001.596444:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1787734001.596459:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec738f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+20:12312:x1874574690061696:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:1.0:1787734001.597339:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec738f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:12312:x1874574690061696:12345-192.168.201.34@tcp:35:umount.0 Request processed in 878us (1929us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787734001.597351:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:3.0:1787734001.602139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734001.603729:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690061952 00000100:00100000:2.0:1787734001.603745:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690061952 00000100:00100000:2.0:1787734001.603812:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:2.0:1787734001.603822:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+21:12312:x1874574690061952:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:2.0:1787734001.604793:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:12312:x1874574690061952:12345-192.168.201.34@tcp:35:umount.0 Request processed in 966us (2671us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787734001.604805:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:0.0:1787734001.609045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734001.609135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734001.609270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734001.609336:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690062208 00000100:00100000:1.0:1787734001.609348:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690062208 00000100:00100000:1.0:1787734001.609422:0:11156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690062080 00000100:00100000:1.0:1787734001.609426:0:11156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690062080 00000100:00100000:1.0:1787734001.609452:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1787734001.609463:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b6bb7a2f-8e14-4d78-9208-bab3541e755f+14:2354:x1874574690062208:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787734001.609481:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787734001.609505:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891efe7ed400/0x45228d86de4d555c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19308 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734001.609524:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787734001.609612:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b6bb7a2f-8e14-4d78-9208-bab3541e755f+13:2354:x1874574690062208:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 151us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734001.609621:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1787734001.609648:0:11156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1787734001.609655:0:11156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:2354:x1874574690062080:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787734001.609663:0:11156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787734001.609672:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891efe7edc00/0x45228d86de4d5594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19340 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734001.609682:0:11156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787734001.609698:0:11156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:2354:x1874574690062080:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 44us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734001.609705:0:11156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787734001.611647:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734001.611961:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690062464 00000100:00100000:1.0:1787734001.611972:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690062464 00000100:00100000:1.0:1787734001.612054:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:1.0:1787734001.612065:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2353:x1874574690062464:12345-192.168.201.34@tcp:9:umount.0 00000020:00000080:1.0:1787734001.612107:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d58ce 00000100:00080000:1.0:1787734001.612126:0:6681:0:(import.c:65:import_set_state_nolock()) ffff891f0184d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787734001.612204:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787734001.612526:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2c26bfa-a021-441a-9db5-0c3742b5640d+2:2353:x1874574690062464:12345-192.168.201.34@tcp:9:umount.0 Request processed in 462us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734001.612534:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00010000:00010000:1.0:1787734001.612700:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787734001.612988:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787734001.613091:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690062336 00000100:00100000:2.0:1787734001.613103:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690062336 00000100:00100000:2.0:1787734001.613180:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1787734001.613189:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:2354:x1874574690062336:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787734001.613202:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787734001.613225:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891efe7ed800/0x45228d86de4d57ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1940b expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.613247:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787734001.613278:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2354:x1874574690062336:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 91us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734001.613285:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1787734001.622051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734001.625635:0:12052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690062848 00000100:00100000:3.0:1787734001.625663:0:12052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690062848 00000100:00100000:0.0:1787734001.625871:0:12052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:0.0:1787734001.625892:0:12052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+7:2353:x1874574690062848:12345-192.168.201.34@tcp:9:umount.0 00000020:00000080:0.0:1787734001.625968:0:12052:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5b2f 00000020:00010000:0.0:1787734001.625979:0:12052:0:(genops.c:1921:obd_stale_export_put()) Put export ffff891efe87f800: total 0 00000100:00080000:0.0:1787734001.625986:0:12052:0:(import.c:65:import_set_state_nolock()) ffff891efe87a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787734001.626048:0:12052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787734001.626552:0:12052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a2c26bfa-a021-441a-9db5-0c3742b5640d+5:2353:x1874574690062848:12345-192.168.201.34@tcp:9:umount.0 Request processed in 666us (4515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734001.626576:0:12052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00000020:00010000:1.0:1787734001.626823:0:11155:0:(genops.c:1907:obd_stale_export_get()) Get export ffff891efe87f800: total 0 00010000:00010000:1.0:1787734001.626859:0:11155:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff891efe87f800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787734001.626929:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2abce6/0x45228d86de4d6570 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197ae expref: 4 pid: 12052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734001.626988:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008de4c3a6/0x45228d86de4d5ed2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195e0 expref: 3 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734001.627004:0:11155:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff891efe87f800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787734001.627016:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734001.627018:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734001.627020:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787734001.627618:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787734001.641220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734001.641390:0:8190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690063872 00000100:00100000:3.0:1787734001.641405:0:8190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690063872 00000100:00100000:3.0:1787734001.641479:0:8190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 240 00000100:00100000:3.0:1787734001.641491:0:8190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+22:2353:x1874574690063872:12345-192.168.201.34@tcp:39:umount.0 00000020:00000080:3.0:1787734001.641539:0:8190:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d556a 00000020:00010000:3.0:1787734001.641584:0:8190:0:(genops.c:1921:obd_stale_export_put()) Put export ffff891ec6d30000: total 0 00000100:00080000:3.0:1787734001.641608:0:8190:0:(import.c:65:import_set_state_nolock()) ffff891ec6d31800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787734001.641765:0:8190:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:2.0:1787734001.642041:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff891ec6d30000: total 0 00010000:00010000:2.0:1787734001.642112:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff891ec6d30000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787734001.642341:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0dfc800) 00010000:00010000:2.0:1787734001.642346:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787734001.642356:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030c00/0x45228d86de4d5f34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195fc expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.642383:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ec6634200) 00010000:00010000:2.0:1787734001.642386:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787734001.642390:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ece00/0x45228d86de4d5850 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19420 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.642416:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:2.0:1787734001.642419:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787734001.642424:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b61800/0x45228d86de4d6531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19799 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.642437:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:2.0:1787734001.642439:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787734001.642443:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ef6b60000/0x45228d86de4d655b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197a7 expref: 18 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.642455:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:2.0:1787734001.642458:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787734001.642462:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd000/0x45228d86de4d5e93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195cb expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.642477:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:2.0:1787734001.642480:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787734001.642484:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7eda00/0x45228d86de4d5ebd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df195d9 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.642512:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787734001.642514:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787734001.642519:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d622f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df196d5 expref: 15 pid: 8190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.642532:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787734001.642534:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787734001.642538:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d5b91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19507 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.642550:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff891ed3d91500) 00010000:00010000:2.0:1787734001.642552:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787734001.642556:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13caa00/0x45228d86de4d5834 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19419 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734001.643760:0:8190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2c26bfa-a021-441a-9db5-0c3742b5640d+12:2353:x1874574690063872:12345-192.168.201.34@tcp:39:umount.0 Request processed in 2262us (2599us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787734001.643775:0:8190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 240 00010000:00010000:2.0:1787734001.643901:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff891ec6634400) 00010000:00010000:2.0:1787734001.643904:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787734001.643910:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891efe7ede00/0x45228d86de4d5f50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19603 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.643942:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff891ec28ef200) 00010000:00010000:2.0:1787734001.643945:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787734001.643950:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030800/0x45228d86de4d5db3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19593 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.643969:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891ee0dfc600) 00010000:00010000:2.0:1787734001.643971:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787734001.643988:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031c00/0x45228d86de4d58a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19435 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.644008:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff891ec6771300) 00010000:00010000:2.0:1787734001.644010:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787734001.644014:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6451 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19761 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734001.644031:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff891ec6d30000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787734001.644059:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734001.644062:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734001.644064:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734002.108843:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787734002.856516:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734002.856580:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734002.856619:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734002.856661:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690064000 00000100:00100000:1.0:1787734002.856680:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690064000 00000100:00100000:0.0:1787734002.856744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734002.856767:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690064256 00000100:00100000:1.0:1787734002.856771:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690064256 00000100:00100000:1.0:1787734002.856790:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690064128 00000100:00100000:1.0:1787734002.856793:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690064128 00000100:00100000:3.0:1787734002.856808:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1787734002.856887:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+12:2356:x1874574690064000:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787734002.856911:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734002.856941:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13cb000/0x45228d86de4d563c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19355 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734002.856966:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734002.857052:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:2356:x1874574690064000:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 173us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734002.857387:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690064512 00000100:00100000:0.0:1787734002.857392:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690064512 00000100:00100000:0.0:1787734002.857445:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 241 00000100:00100000:0.0:1787734002.857457:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+6:2353:x1874574690064512:12345-192.168.201.34@tcp:39:umount.0 00000100:00100000:1.0:1787734002.857734:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1787734002.857745:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef0384c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+11:2356:x1874574690064256:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787734002.857758:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787734002.857771:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13ca200/0x45228d86de4d57d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19404 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734002.857784:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787734002.857815:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef0384c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+10:2356:x1874574690064256:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 73us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734002.857824:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1787734002.857844:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:1.0:1787734002.857851:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+9:2356:x1874574690064128:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787734002.858971:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787734002.858990:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec60cde00/0x45228d86de4d5643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1937f expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734002.859008:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787734002.859041:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6bb7a2f-8e14-4d78-9208-bab3541e755f+8:2356:x1874574690064128:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 1190us (2421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734002.859049:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000020:00000080:0.0:1787734002.859649:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5651 00000020:00010000:0.0:1787734002.859664:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff891ec604a800: total 0 00000100:00080000:0.0:1787734002.859669:0:5833:0:(import.c:65:import_set_state_nolock()) ffff891ec604c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787734002.859703:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787734002.860064:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d03688db-9dbe-4e59-8844-cd2ed369e4a4+5:2353:x1874574690064512:12345-192.168.201.34@tcp:39:umount.0 Request processed in 2608us (3317us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787734002.860074:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 241 00000100:00080000:0.0:1787734002.860118:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1787734002.860181:0:11155:0:(genops.c:1907:obd_stale_export_get()) Get export ffff891ec604a800: total 0 00010000:00010000:0.0:1787734002.860185:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734002.860234:0:11155:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff891ec604a800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787734002.860270:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0dfc800) 00010000:00010000:0.0:1787734002.860284:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787734002.860292:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d657e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197b5 expref: 4 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734002.860319:0:11155:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff891ec604a800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787734002.860331:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734002.860333:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734002.860335:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787734002.869417:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1787734002.878080:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734002.878213:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690064768 00000100:00100000:2.0:1787734002.878226:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690064768 00000100:00100000:2.0:1787734002.878300:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 291 00000100:00100000:2.0:1787734002.878311:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+7:2353:x1874574690064768:12345-192.168.201.34@tcp:251:umount.0 00000020:00000080:2.0:1787734002.878369:0:5826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5547 00000020:00010000:2.0:1787734002.878377:0:5826:0:(genops.c:1921:obd_stale_export_put()) Put export ffff891ec6d37000: total 0 00000100:00080000:2.0:1787734002.878383:0:5826:0:(import.c:65:import_set_state_nolock()) ffff891ec6d35800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787734002.878434:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff891ec6d37000: total 0 00000100:00100000:2.0:1787734002.878468:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6bb7a2f-8e14-4d78-9208-bab3541e755f+3:2353:x1874574690064768:12345-192.168.201.34@tcp:251:umount.0 Request processed in 158us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734002.878491:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 291 00010000:00010000:3.0:1787734002.878497:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff891ec6d37000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787734002.878549:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891efe7ec800/0x45228d86de4d559b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19347 expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734002.878576:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff891ec6d37000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787734002.878591:0:5821:0:(genops.c:885:class_export_put()) final put ffff891ec6d37000/b6bb7a2f-8e14-4d78-9208-bab3541e755f 00000020:00000080:2.0:1787734002.878630:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec6d37000/b6bb7a2f-8e14-4d78-9208-bab3541e755f for MGS 00010000:00010000:3.0:1787734002.878654:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734002.878658:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734002.878660:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787734002.878689:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ec6d35800 for MGS 00010000:00010000:3.0:1787734003.130345:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787734003.514348:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705768576:0@lo:400:kworker.0 00000100:00100000:1.0:1787734003.514405:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734003.514458:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787734003.514462:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef6802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705768448:0@lo:400:kworker.0 00000100:00100000:1.0:1787734003.514480:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734003.514505:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705768576 00000100:00100000:2.0:1787734003.514510:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705768320:0@lo:400:kworker.0 00000100:00100000:1.0:1787734003.514511:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705768576 00000100:00100000:1.0:1787734003.514560:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787734003.514566:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734003.514570:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705768576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734003.514597:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705768832:0@lo:400:kworker.0 00000100:00100000:1.0:1787734003.514615:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705768576:12345-0@lo:400:kworker.0 Request processed in 46us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734003.514621:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787734003.514631:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734003.514645:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705768448 00000100:00100000:1.0:1787734003.514649:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705768448 00000100:00100000:2.0:1787734003.514671:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787734003.514680:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705768320 00000100:00100000:2.0:1787734003.514682:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705768192:0@lo:400:kworker.0 00000100:00100000:1.0:1787734003.514685:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705768320 00000100:00100000:1.0:1787734003.514706:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787734003.514713:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705768448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734003.514740:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734003.514744:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705768448:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734003.514755:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787734003.514764:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787734003.514768:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705768320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734003.515003:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705768320:12345-0@lo:400:kworker.0 Request processed in 234us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734003.515006:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705768704:0@lo:400:kworker.0 00000100:00100000:1.0:1787734003.515013:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1787734003.515028:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787734003.515033:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787734003.515043:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705768832 00000100:00100000:1.0:1787734003.515047:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705768832 00000100:00100000:2.0:1787734003.515054:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734003.515108:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705768320:0@lo:400:kworker.0 00000100:00100000:3.0:1787734003.515115:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705768704 00000100:00100000:3.0:1787734003.515121:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705768704 00000100:00080000:0.0:1787734003.515124:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787734003.515148:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787734003.515180:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705768832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734003.515194:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705768192 00000100:00100000:2.0:1787734003.515200:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705768192 00000100:00100000:3.0:1787734003.515204:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787734003.515216:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705768704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734003.515239:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787734003.515241:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705768832:12345-0@lo:400:kworker.0 Request processed in 84us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734003.515251:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787734003.515261:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705768832:0@lo:400:kworker.0 00000100:00100000:2.0:1787734003.515263:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec6126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705768192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787734003.515280:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705768704:12345-0@lo:400:kworker.0 Request processed in 66us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734003.515287:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef6802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705768448:0@lo:400:kworker.0 00000100:00100000:0.0:1787734003.515287:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705768704:0@lo:400:kworker.0 00000100:00100000:3.0:1787734003.515292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787734003.515299:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787734003.515305:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891eefd85180, transno 4294967324 00000100:00100000:1.0:1787734003.515318:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705768576:0@lo:400:kworker.0 00000100:00080000:3.0:1787734003.515319:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787734003.515480:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec6126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:df19622b-ae94-4c8d-b052-574898624480+19:3311:x1874574705768192:12345-0@lo:400:kworker.0 Request processed in 232us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734003.515510:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:df19622b-ae94-4c8d-b052-574898624480:3311:1874574705768192:0@lo:400:kworker.0 00000100:00100000:2.0:1787734003.515594:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787734004.026850:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787734004.027119:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705768960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787734004.027248:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734004.032339:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705768960 00000100:00100000:0.0:1787734004.032354:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705768960 00000100:00100000:0.0:1787734004.032424:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787734004.032436:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705768960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787734004.032475:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787734004.032557:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705768960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (5309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734004.032569:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787734004.032603:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705768960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787734004.158344:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787734004.290733:0:13047:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787734004.304400:0:13047:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787734004.304440:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.304451:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.304456:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.304460:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.304484:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787734004.304500:0:13047:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787734004.304520:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787734004.304525:0:13047:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787734004.304529:0:13047:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787734004.304551:0:13047:0:(import.c:65:import_set_state_nolock()) ffff891ef6c89800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787734004.304659:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874574705769088:0@lo:39:umount.0 00000100:00100000:0.0:1787734004.304726:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787734004.305122:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734004.305130:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.305140:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891efe7ec400 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787734004.305144:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.305171:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787734004.305180:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734004.305185:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787734004.305188:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787734004.305190:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787734004.305218:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.305225:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787734004.305236:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705769088 00010000:00010000:3.0:1787734004.305250:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734004.305251:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705769088 00010000:00010000:3.0:1787734004.305274:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891efe7ec400/0x45228d86de4d55fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d5604 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.305287:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734004.305290:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734004.305293:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787734004.305306:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787734004.305317:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874574705769088:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787734004.305341:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5356 00000100:00080000:1.0:1787734004.305348:0:5833:0:(import.c:65:import_set_state_nolock()) ffff891ef5d7b800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787734004.305432:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1874574705769088:12345-0@lo:39:umount.0 Request processed in 116us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734004.305439:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00010000:3.0:1787734004.305448:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787734004.305450:0:5833:0:(genops.c:885:class_export_put()) final put ffff891ef5d7b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787734004.305487:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff891ef5d7b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1787734004.305519:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ef6c89800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787734004.305530:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874574705769088:0@lo:39:umount.0 00000020:00000080:3.0:1787734004.305537:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ef5d7b800 for lustre-MDT0000 00000100:00100000:0.0:1787734004.305613:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705769216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787734004.305648:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787734004.305954:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787734004.305959:0:13047:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787734004.305962:0:13047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787734004.306444:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705769216 00000100:00100000:1.0:1787734004.306451:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705769216 00000100:00100000:1.0:1787734004.306504:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787734004.306513:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705769216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787734004.306525:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787734004.306542:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13cac00/0x45228d86de4d5604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d55fd expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734004.306557:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787734004.306610:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df19622b-ae94-4c8d-b052-574898624480+18:3313:x1874574705769216:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734004.306617:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787734004.306827:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.306837:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.306844:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.306851:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.306868:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787734004.306874:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.306881:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.306888:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734004.306893:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705769216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787734004.306893:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734004.306901:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734004.306920:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658200 already unused, calling callback (ffffffffc1b18c20) 00010000:00010000:2.0:1787734004.306921:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787734004.306933:0:11155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734004.306943:0:11155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.306944:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787734004.306958:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787734004.306958:0:11155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.306965:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734004.306973:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787734004.306980:0:11155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787734004.306981:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787734004.306988:0:11155:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787734004.306989:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0e00 already unused, calling callback (ffffffffc1b18c20) 00010000:00010000:2.0:1787734004.306993:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787734004.306996:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.306999:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734004.307009:0:11155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.307013:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734004.307023:0:11155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787734004.307025:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:3.0:1787734004.307028:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.307030:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734004.307044:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787734004.307045:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734004.307047:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734004.307050:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787734004.307054:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787734004.307063:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734004.307066:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec6658200/0x45228d86de4d560b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d5612 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734004.307080:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.307082:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.307106:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787734004.307108:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787734004.307113:0:13047:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787734004.307115:0:13047:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787734004.307116:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.307124:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d5501 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d5508 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787734004.307135:0:13047:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787734004.307140:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:3.0:1787734004.307141:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:2.0:1787734004.307144:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1787734004.307146:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787734004.307151:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00010000:00010000:3.0:1787734004.307172:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658a00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787734004.307177:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.307185:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787734004.307193:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734004.307193:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787734004.307203:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00080000:2.0:1787734004.307204:0:13047:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff891dc5657000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:3.0:1787734004.307207:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787734004.307210:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:2.0:1787734004.307214:0:13047:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff891ec6e5b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787734004.307222:0:13047:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff891ec604a800 d03688db-9dbe-4e59-8844-cd2ed369e4a4 192.168.201.34@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1787734004.307227:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787734004.307228:0:13047:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff891ec6d30000 a2c26bfa-a021-441a-9db5-0c3742b5640d 192.168.201.34@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:2.0:1787734004.307241:0:13047:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff891ed20119b8) has exports, disconnecting them 00010000:00010000:3.0:1787734004.307242:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1787734004.307249:0:13047:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff891dc5657000), last request at 1787734003 00000020:00000080:2.0:1787734004.307255:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d54c9 00010000:00010000:3.0:1787734004.307261:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787734004.307271:0:13047:0:(import.c:65:import_set_state_nolock()) ffff891dc5655800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787734004.307283:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d5803 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d580a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.307296:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734004.307299:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734004.307302:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787734004.307317:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705769600:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787734004.307318:0:13047:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff891dc5657000): rc 0 00000020:00000080:2.0:1787734004.307324:0:13047:0:(genops.c:885:class_export_put()) final put ffff891dc5657000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787734004.307338:0:13047:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff891ec6e5b800), last request at 1787734003 00010000:00010000:0.0:1787734004.307341:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787734004.307342:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d53f0 00000100:00080000:2.0:1787734004.307348:0:13047:0:(import.c:65:import_set_state_nolock()) ffff891ec6e58800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787734004.307356:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734004.307359:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787734004.307363:0:13047:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff891ec6e5b800): rc 0 00000020:00000080:2.0:1787734004.307370:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ec6e5b800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1787734004.307372:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020fe200 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787734004.307377:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:2.0:1787734004.307380:0:13047:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb062c433bae0 00010000:00010000:0.0:1787734004.307388:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787734004.307397:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787734004.307400:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:3.0:1787734004.307404:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787734004.307405:0:13047:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 10000000:01000000:0.0:1787734004.307406:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787734004.307412:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787734004.307415:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000004:00080000:2.0:1787734004.307431:0:13047:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1787734004.307432:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734004.307438:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787734004.307459:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734004.307460:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705769728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787734004.307472:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020fe200/0x45228d86de4d52b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d52bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734004.307493:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787734004.307501:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787734004.307503:0:13047:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:0.0:1787734004.307506:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734004.307510:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787734004.307517:0:13047:0:(import.c:65:import_set_state_nolock()) ffff891ef032a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787734004.307518:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734004.307521:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787734004.307530:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705769600 00000100:00080000:2.0:1787734004.307533:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787734004.307536:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705769600 00000100:00100000:2.0:1787734004.307536:0:13047:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787734004.307552:0:13047:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787734004.307570:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705769728 00000100:00100000:3.0:1787734004.307575:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705769728 00010000:00010000:1.0:1787734004.307578:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734004.307582:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734004.307585:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787734004.307599:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705769344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787734004.307604:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787734004.307613:0:13047:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787734004.307614:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+19:3312:x1874574705769600:12345-0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787734004.307623:0:13047:0:(import.c:65:import_set_state_nolock()) ffff891efe96f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787734004.307625:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734004.307639:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891efe7ed200/0x45228d86de4d580a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d5803 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734004.307640:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787734004.307655:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1787734004.307655:0:13047:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff891ed20119b8) has no exports 00000100:00100000:1.0:1787734004.307678:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787734004.307687:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705769472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787734004.307690:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+18:3312:x1874574705769600:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734004.307699:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787734004.307712:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705769344 00000100:00100000:3.0:1787734004.307716:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705769344 00000100:00100000:1.0:1787734004.307718:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734004.307740:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705769472 00000100:00100000:3.0:1787734004.307743:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705769472 00000100:00100000:1.0:1787734004.307754:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787734004.307865:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+19:3313:x1874574705769728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787734004.307875:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787734004.307883:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec0031400/0x45228d86de4d52bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d52b5 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734004.307895:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787734004.307933:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df19622b-ae94-4c8d-b052-574898624480+18:3313:x1874574705769728:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734004.307981:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df19622b-ae94-4c8d-b052-574898624480:3313:1874574705769728:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787734004.310062:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891dc5657000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787734004.310152:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec6e5b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1787734004.310178:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787734004.310196:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+18:3310:x1874574705769344:12345-0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787734004.310202:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891dc5655800 for lustre-MDT0000 00000020:00000080:0.0:1787734004.310208:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ec6e58800 for lustre-MDT0000 00010000:00010000:3.0:1787734004.310210:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787734004.310227:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705769856:0@lo:9:umount.0 00010000:00010000:3.0:1787734004.310230:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec6658c00/0x45228d86de4d5612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d560b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.310260:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787734004.310288:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734004.310314:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+17:3310:x1874574705769344:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (2675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734004.310322:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705769984:0@lo:9:umount.0 00000100:00100000:3.0:1787734004.310324:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787734004.310350:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787734004.310356:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734004.310361:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+16:3310:x1874574705769472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787734004.310371:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734004.310382:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec0030400/0x45228d86de4d5508 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d5501 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734004.310396:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734004.310423:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df19622b-ae94-4c8d-b052-574898624480+15:3310:x1874574705769472:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734004.310429:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787734004.311851:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787734004.312014:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df19622b-ae94-4c8d-b052-574898624480:3312:1874574705769600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787734004.312226:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705769856 00000100:00100000:2.0:1787734004.312233:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705769856 00000100:00100000:2.0:1787734004.312265:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705769984 00000100:00100000:2.0:1787734004.312267:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705769984 00000100:00100000:2.0:1787734004.312408:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787734004.312415:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef61f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874574705769856:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787734004.312437:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d543d 00000100:00080000:2.0:1787734004.312444:0:6682:0:(import.c:65:import_set_state_nolock()) ffff891dc5652800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787734004.312602:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787734004.314116:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787734004.314136:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874574705769984:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787734004.314177:0:6729:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5532 00000100:00080000:0.0:1787734004.314186:0:6729:0:(import.c:65:import_set_state_nolock()) ffff891ec6c80800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787734004.314218:0:6729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787734004.315193:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3309:x1874574705769984:12345-0@lo:9:umount.0 Request processed in 1064us (4834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734004.315202:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1787734004.315250:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787734004.315283:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891efe96f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787734004.315299:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef61f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3309:x1874574705769856:12345-0@lo:9:umount.0 Request processed in 2881us (5008us total) trans 0 rc 0/0 00000004:00080000:0.0:1787734004.315299:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787734004.315303:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787734004.315309:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705769984:0@lo:9:umount.0 00000100:00100000:2.0:1787734004.315314:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787734004.315340:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ef032a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787734004.315354:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787734004.315356:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1787734004.315360:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787734004.315360:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705769856:0@lo:9:umount.0 00000100:00100000:1.0:1787734004.316224:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705769472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787734004.316240:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705769344:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787734004.324780:0:13047:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff891ed20119b8) has no exports 00000020:00000080:0.0:1787734004.380134:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5310 00000020:00000080:0.0:1787734004.380150:0:13047:0:(genops.c:885:class_export_put()) final put ffff891eefced800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787734004.380425:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787734004.380457:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff891eefced800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787734004.380488:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787734004.380498:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787734004.380502:0:13047:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff891ef64a99b8) has no exports 00000020:00000080:2.0:1787734004.381558:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5309 00000020:00000080:2.0:1787734004.381574:0:13047:0:(genops.c:885:class_export_put()) final put ffff891eeff0f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787734004.381642:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff891eeff0f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787734004.381714:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787734004.381722:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787734004.381725:0:13047:0:(genops.c:885:class_export_put()) final put ffff891eeff0d000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787734004.381727:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff891eeff0d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787734004.381732:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1787734005.181372:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787734005.607100:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787734005.607109:0:7629:0:(genops.c:885:class_export_put()) final put ffff891ec6c87000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787734005.607215:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec6c87000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787734005.607260:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ec6c80800 for lustre-OST0001 00000001:00100000:1.0:1787734005.607498:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000020:00000080:1.0:1787734005.607502:0:7629:0:(genops.c:885:class_export_put()) final put ffff891ec7d3f000/a2c26bfa-a021-441a-9db5-0c3742b5640d 00000020:00000080:0.0:1787734005.607565:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec7d3f000/a2c26bfa-a021-441a-9db5-0c3742b5640d for lustre-OST0001 00000020:00000080:0.0:1787734005.607756:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891f0184d800 for lustre-OST0001 00000001:00100000:3.0:1787734006.127008:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000020:00000080:3.0:1787734006.127017:0:6705:0:(genops.c:885:class_export_put()) final put ffff891efe87f800/a2c26bfa-a021-441a-9db5-0c3742b5640d 00000001:00100000:3.0:1787734006.127036:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787734006.127061:0:6705:0:(genops.c:885:class_export_put()) final put ffff891dc5650000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787734006.128427:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891efe87f800/a2c26bfa-a021-441a-9db5-0c3742b5640d for lustre-OST0000 00000020:00000080:2.0:1787734006.128488:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891dc5650000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787734006.128604:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891efe87a000 for lustre-OST0000 00000020:00000080:2.0:1787734006.128610:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891dc5652800 for lustre-OST0000 00000001:00100000:2.0:1787734006.147083:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d03688db-9dbe-4e59-8844-cd2ed369e4a4 00000001:00080000:2.0:1787734006.147107:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787734006.147111:0:5854:0:(genops.c:885:class_export_put()) final put ffff891ec604a800/d03688db-9dbe-4e59-8844-cd2ed369e4a4 00000001:00080000:2.0:1787734006.148999:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:2.0:1787734006.149018:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1787734006.149028:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a2c26bfa-a021-441a-9db5-0c3742b5640d 00000001:00080000:2.0:1787734006.149033:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1787734006.149036:0:5854:0:(genops.c:885:class_export_put()) final put ffff891ec6d30000/a2c26bfa-a021-441a-9db5-0c3742b5640d 00000020:00000080:0.0:1787734006.149100:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec604a800/d03688db-9dbe-4e59-8844-cd2ed369e4a4 for lustre-MDT0000 00000020:00000080:0.0:1787734006.149151:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec6d30000/a2c26bfa-a021-441a-9db5-0c3742b5640d for lustre-MDT0000 00000020:00000080:0.0:1787734006.149202:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ec604c000 for lustre-MDT0000 00000020:00000080:0.0:1787734006.149207:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ec6d31800 for lustre-MDT0000 00010000:00010000:1.0:1787734006.202623:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787734006.395378:0:13047:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff891ec3de64e0 - data ffff891f01e7da20/ffff891efeb1ec00 00000020:01000000:2.0:1787734006.395505:0:13047:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff891ed0b0fea0 - data ffff891ee775e798/ffff891ef6c92c00 00000001:00000004:2.0:1787734006.403751:0:13047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787734006.520518:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787734006.520527:0:13047:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787734006.520551:0:13047:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787734006.520554:0:13047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787734006.521070:0:6725:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787734006.521075:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1787734006.521094:0:6725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787734006.522677:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787734006.522684:0:13047:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787734006.522706:0:13047:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787734006.522709:0:13047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787734006.523028:0:7998:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787734006.523042:0:7998:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787734006.523054:0:7998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787734006.580463:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d52d8 00000020:00000080:3.0:1787734006.580474:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ec8154800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787734006.580498:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec8154800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787734006.581242:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d52ed 00000020:00000080:3.0:1787734006.581250:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ef6c8f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787734006.581262:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787734006.581267:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787734006.581276:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1787734006.581278:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ef6c8f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00080000:3.0:1787734006.581280:0:13047:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff891ed2010000) has no exports 00000004:01000000:3.0:1787734006.581409:0:13047:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787734006.581417:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d552b 00000020:00000080:3.0:1787734006.581420:0:13047:0:(genops.c:885:class_export_put()) final put ffff891dc57e8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787734006.581429:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787734006.581432:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787734006.581438:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787734006.581441:0:13047:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff891ee57b8000) has no exports 00000020:00000080:2.0:1787734006.581445:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891dc57e8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787734006.581446:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5524 00000020:00000080:3.0:1787734006.581450:0:13047:0:(genops.c:885:class_export_put()) final put ffff891efe96b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787734006.581456:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891efe96b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787734006.582025:0:13047:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787734006.582029:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787734006.582042:0:13047:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787734006.582047:0:13047:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787734006.582049:0:13047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787734006.582082:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787734006.582084:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891efe96f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787734006.582090:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787734006.582093:0:13047:0:(genops.c:885:class_export_put()) final put ffff891efe96d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787734006.582105:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff891efe96d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787734006.582110:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787734006.582189:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5436 00000020:00000080:3.0:1787734006.582194:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ef5d7e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787734006.582201:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787734006.582204:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787734006.582209:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787734006.582211:0:13047:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff891ef64acd28) has no exports 00000020:00000080:3.0:1787734006.582215:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d542f 00000020:00000080:3.0:1787734006.582218:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ef032c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787734006.582281:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ef5d7e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787734006.582289:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ef032c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787734006.582615:0:13047:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787734006.582680:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787734006.582683:0:13047:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787734006.582686:0:13047:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787734006.582688:0:13047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787734006.582725:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ef032a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787734006.582727:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787734006.582731:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787734006.582735:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ef5d7f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787734006.582738:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff891ef5d7f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787734006.582743:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787734006.582870:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787734006.582875:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787734006.582879:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ec73e9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787734006.582882:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec73e9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787734006.582887:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787734006.583007:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d52f4 00000020:00000080:3.0:1787734006.583011:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ef6c8b800/lustre-MDD0000_UUID 00000020:01000000:3.0:1787734006.583024:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787734006.583026:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787734006.583029:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787734006.583046:0:13047:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff891ed2014d28) has no exports 00000020:00000080:3.0:1787734006.583065:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787734006.583069:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787734006.583072:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d52fb 00000020:00000080:3.0:1787734006.583075:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ef6c88000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787734006.583083:0:13047:0:(tgt_mount.c:187:server_put_mount()) put mount ffff891ec7b73800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787734006.583086:0:13047:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891ec7b73800 3 00000020:01000004:3.0:1787734006.583089:0:13047:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff891ec7b73800 from lustre-MDT0000 00000020:00000080:3.0:1787734006.583106:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787734006.583109:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787734006.583112:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ec8152000/lustre-MDT0000_UUID 00000020:00000080:3.0:1787734006.583114:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec8152000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787734006.583120:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787734006.583145:0:13047:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:00000080:2.0:1787734006.583145:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ef6c8b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:3.0:1787734006.583151:0:13047:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:00000080:2.0:1787734006.583152:0:36:0:(genops.c:885:class_export_put()) final put ffff891ec73eb000/lustre-MDD0000_UUID 00000020:01000000:3.0:1787734006.583176:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787734006.583180:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec73eb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787734006.583182:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787734006.583187:0:13047:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:01000000:2.0:1787734006.583188:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00080000:3.0:1787734006.583194:0:13047:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff891ec61d0000 df19622b-ae94-4c8d-b052-574898624480 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787734006.583200:0:13047:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff891ee56e8000) has exports, disconnecting them 00000020:00080000:3.0:1787734006.583205:0:13047:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff891ec61d0000), last request at 1787733807 00000020:00000080:3.0:1787734006.583220:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5299 00000020:00010000:3.0:1787734006.583225:0:13047:0:(genops.c:1921:obd_stale_export_put()) Put export ffff891ec61d0000: total 2 00000100:00080000:3.0:1787734006.583229:0:13047:0:(import.c:65:import_set_state_nolock()) ffff891ec61d3800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787734006.583248:0:13047:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff891ec61d0000): rc 0 00000020:00080000:3.0:1787734006.583252:0:13047:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff891ee56e8000) has no exports 00000020:00010000:0.0:1787734006.583290:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff891ec61d0000: total 2 00010000:00010000:0.0:1787734006.583337:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff891ec61d0000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787734006.583367:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891efe7ecc00/0x45228d86de4d55e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d55e1 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734006.583384:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec60cd800/0x45228d86de4d57e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d57e0 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734006.583395:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891efe7eca00/0x45228d86de4d55da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d55d3 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734006.583405:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13cba00/0x45228d86de4d53a3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d539c expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734006.583418:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec6659600/0x45228d86de4d55b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d55a9 expref: 5 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734006.583439:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020fe400/0x45228d86de4d55be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d55b7 expref: 4 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734006.583449:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891efe7ed000/0x45228d86de4d57fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d57f5 expref: 3 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734006.583460:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec13cb200/0x45228d86de4d562e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45228d86de4d5627 expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734006.583470:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff891ec61d0000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787734006.583481:0:5820:0:(genops.c:885:class_export_put()) final put ffff891ec61d0000/df19622b-ae94-4c8d-b052-574898624480 00010000:00010000:0.0:1787734006.583493:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734006.583496:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734006.583498:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787734006.583761:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ef6c88000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787734006.583766:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec61d0000/df19622b-ae94-4c8d-b052-574898624480 for MGS 00000020:00000080:2.0:1787734006.583788:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ec61d3800 for MGS 00000100:00100000:2.0:1787734006.583817:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff891ec6de3e00:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1787734006.583891:0:5827:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff891ed0b8ae00:5827] 2 exiting: rc = 0 00000100:00100000:2.0:1787734006.583945:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff891ec60a8000:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1787734006.583987:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.583997:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584003:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584009:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584015:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584020:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584044:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584051:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584057:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584062:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584068:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584075:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584081:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584087:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584092:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584097:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584101:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584106:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584109:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584113:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584117:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584120:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584123:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584127:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584130:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584135:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584142:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584149:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584174:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584182:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584190:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584196:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584202:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584207:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584212:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584218:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584225:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584231:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584237:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584243:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584251:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584265:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584270:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584275:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584280:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584287:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584294:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584302:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584309:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584316:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584323:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584331:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584340:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584348:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584355:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584361:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584368:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584377:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584384:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584391:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584397:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584401:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584407:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.584413:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787734006.584982:0:13047:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787734006.584985:0:13047:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787734006.585540:0:13047:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff891ec3de6240 - data ffff891f01e7d798/ffff891efeb1cc00 00000020:01000000:3.0:1787734006.585811:0:13047:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff891ec3d90a20 - data ffff891ee77c7a20/ffff891ec61c9800 00000020:00000080:3.0:1787734006.586283:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d527d 00000020:00000080:3.0:1787734006.586289:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ec3381000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787734006.586305:0:13047:0:(tgt_mount.c:187:server_put_mount()) put mount ffff891ec7b73800 from MGS, refs=2 00000020:01000004:3.0:1787734006.586308:0:13047:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891ec7b73800 2 00000020:01000004:3.0:1787734006.586310:0:13047:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff891ec7b73800 from MGS 00000020:00000080:3.0:1787734006.586333:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787734006.586337:0:13047:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787734006.586344:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ec3382000/MGS 00000020:00000080:3.0:1787734006.586347:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec3382000/MGS for MGS 00000020:01000000:3.0:1787734006.586352:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787734006.586395:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787734006.586397:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787734006.586401:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787734006.586406:0:13047:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff891ef6c8d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787734006.586411:0:13047:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff891ef6c699b8) has exports, disconnecting them 00000020:00080000:3.0:1787734006.586415:0:13047:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff891ef6c8d000), last request at 1787733808 00000020:00000080:3.0:1787734006.586418:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5348 00000020:00080000:3.0:1787734006.586422:0:13047:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff891ef6c8d000): rc 0 00000020:00000080:3.0:1787734006.586426:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ef6c8d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787734006.586473:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec3381000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787734006.586487:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ef6c8d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787734006.586955:0:13047:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787734006.586959:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787734006.586963:0:13047:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787734006.586968:0:13047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787734006.587042:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ef6c89800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787734006.587121:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787734006.587127:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787734006.587131:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ef6c8a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787734006.587134:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff891ef6c8a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787734006.587141:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787734006.587194:0:13047:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891ec7b73800 1 00000020:00000080:3.0:1787734006.587199:0:13047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d526f 00000020:00000080:3.0:1787734006.587204:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ec3383000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787734006.587215:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787734006.587218:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787734006.587221:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787734006.587224:0:13047:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff891ef0320000) has no exports 00000020:00000080:2.0:1787734006.587248:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec3383000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787734006.602139:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787734006.602178:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787734006.602185:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ec7b75000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787734006.602191:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec7b75000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787734006.602202:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787734006.602347:0:13047:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff891ec7b77800 00000020:01000000:2.0:1787734006.602379:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787734006.602384:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787734006.602390:0:13047:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787734006.602541:0:13047:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff891ed2013370) has no exports 00000100:00100000:2.0:1787734006.602637:0:8190:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff891ef61cb400:8190] 3 exiting: rc = 0 00000100:00100000:2.0:1787734006.603382:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff891ec61c7600:5834] 2 exiting: rc = 0 00000100:00100000:1.0:1787734006.603793:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff891ec61c7a00:5833] 1 exiting: rc = 0 00000100:00100000:1.0:1787734006.603882:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff891ec61c6400:5832] 0 exiting: rc = 1 00000100:00100000:2.0:1787734006.604256:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604263:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604280:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604286:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604291:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604297:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604301:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604307:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604313:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604319:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604324:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604329:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604334:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604338:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604343:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604348:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604354:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604359:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604364:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604370:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604375:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604380:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604385:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.604390:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.605068:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.605133:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.605140:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.605146:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.605151:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.605970:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.605980:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.605985:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.605991:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.605996:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606001:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606012:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606018:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606052:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606058:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606064:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606070:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606076:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606134:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606142:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606147:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606153:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606182:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606188:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606193:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606198:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606204:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606209:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606215:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606220:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606226:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606233:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606238:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606243:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606248:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606254:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606258:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606263:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606268:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.606284:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.612238:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff891ec61c7800:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1787734006.612263:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff891ef02b8a00:5836] 1 exiting: rc = 0 00000100:00100000:2.0:1787734006.612370:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.612379:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.612386:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613039:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613052:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613058:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613064:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613069:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613087:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613093:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613098:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613104:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613111:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613117:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613122:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613126:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613131:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613135:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613140:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613145:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613150:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613185:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613193:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613198:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613202:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613208:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613212:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613218:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613224:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613228:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613233:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613238:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613243:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613247:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613251:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613261:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613266:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613271:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613276:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613280:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613285:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613290:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613294:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613306:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613311:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613316:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613320:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613325:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613329:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613334:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613338:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613343:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613349:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613353:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613359:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613363:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613368:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613373:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613377:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613382:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613386:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613391:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613607:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.613613:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614069:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff891ef02b8000:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1787734006.614082:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff891ed204b000:5837] 0 exiting: rc = 1 00000100:00100000:3.0:1787734006.614084:0:12051:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff891ee032aa00:12051] 2 exiting: rc = 0 00000100:00100000:2.0:1787734006.614843:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614850:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614856:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614862:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614868:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614873:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614879:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614884:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614891:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614900:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614922:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614931:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614936:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614950:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614956:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614962:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614967:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614972:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614979:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.614984:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615455:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615465:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615484:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615490:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615496:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615505:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615512:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615518:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615523:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615528:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615535:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615540:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615546:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615551:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615575:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615584:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615592:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615599:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615605:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615611:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615616:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615622:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615627:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615634:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615639:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615646:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615864:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615873:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615887:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615893:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615900:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615906:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615912:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615918:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615924:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615930:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615936:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615943:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615962:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615969:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615975:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615981:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615986:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787734006.615992:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734006.632541:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff891ef02b8800:5840] 1 exiting: rc = 0 00000100:00100000:2.0:1787734006.632714:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff891ef02b8e00:5839] 0 exiting: rc = 1 00000100:00100000:3.0:1787734006.632915:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632924:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632931:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632937:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632941:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632946:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632950:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632955:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632959:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632963:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632967:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632971:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632975:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632979:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632984:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632988:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632993:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.632997:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633001:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633006:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633011:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633016:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633019:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633023:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633027:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633040:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633046:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633051:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633054:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633058:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633062:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633066:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633070:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633075:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633084:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633100:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633106:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633109:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633112:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633115:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633118:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633121:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633128:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633132:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633136:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633139:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633142:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633145:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633149:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633152:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633356:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633362:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633368:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633373:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633378:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633382:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633384:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633388:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633391:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633394:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633397:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633400:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633403:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.633406:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734006.633855:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff891ec61c4200:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1787734006.633873:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff891ec61c5800:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1787734006.634128:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634137:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634145:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634153:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634182:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634188:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634204:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634210:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634216:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634223:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634241:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634247:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634254:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634261:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634267:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634275:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634282:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634289:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634296:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634303:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634309:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634320:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634331:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634339:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634343:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634347:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634352:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634365:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634370:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634375:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634379:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634384:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634389:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634394:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634398:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634403:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634407:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634412:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634416:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634421:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634425:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634436:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634441:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634445:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634450:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634453:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634457:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634460:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634463:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634466:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634469:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634472:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634475:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634478:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634481:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634483:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634487:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634489:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634492:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634494:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634497:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634500:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634503:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.634506:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636214:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff891ec61c4600:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1787734006.636427:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff891ec61c5200:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1787734006.636655:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636662:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636667:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636671:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636676:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636681:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636686:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636691:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636696:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636700:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636705:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636718:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636723:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636728:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636732:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636736:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636741:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636745:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636749:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636754:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636759:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636763:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636767:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636771:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636775:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636778:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636782:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636786:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636791:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636795:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636799:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636807:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636816:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636823:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636827:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636830:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636836:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636839:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636844:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636850:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636852:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636856:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636860:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636863:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636867:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636872:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636882:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636888:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636893:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636898:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636909:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636917:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636921:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636926:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636930:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636935:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636939:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636943:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636948:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636952:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636956:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636961:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636965:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.636969:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.637529:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff891ec61c4400:5847] 2 exiting: rc = 0 00000100:00100000:0.0:1787734006.637626:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff891ec61c4e00:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1787734006.639148:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff891ec61c5e00:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1787734006.639632:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639643:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639650:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639658:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639668:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639678:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639690:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639697:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639703:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639708:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639715:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639721:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639726:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639731:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639737:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639742:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639763:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639772:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639779:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639787:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639795:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639803:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639811:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639837:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639845:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639852:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639859:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639867:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639875:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639885:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639893:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639901:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639911:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639919:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639929:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639937:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639944:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639955:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639966:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639973:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639979:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639984:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639991:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.639998:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640003:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640009:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640015:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640057:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640066:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640073:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640081:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640099:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640108:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640116:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640124:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640132:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640141:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640150:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640176:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640184:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640192:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640197:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640203:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787734006.640208:0:13047:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787734006.647954:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787734006.647972:0:13047:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787734006.647978:0:13047:0:(genops.c:885:class_export_put()) final put ffff891ec8157000/MDS_uuid 00000020:00000080:3.0:1787734006.647982:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec8157000/MDS_uuid for MDS 00000020:01000000:3.0:1787734006.647988:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787734006.648200:0:13047:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787734007.232272:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734008.252076:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787734008.534094:0:13201:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787734008.541464:0:13201:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787734008.541512:0:13201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734008.541527:0:13201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734008.541547:0:13201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734008.541555:0:13201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734008.541615:0:13201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787734008.541621:0:13201:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787734008.541643:0:13201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787734008.541647:0:13201:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787734008.541653:0:13201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787734008.541677:0:13201:0:(import.c:65:import_set_state_nolock()) ffff891dc5655000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787734008.541774:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874574705770112:0@lo:39:umount.0 00000400:00000100:2.0:1787734008.541863:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874574705770112 offset 0 length 224: 4 00010000:00010000:0.0:1787734008.541938:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734008.541945:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734008.541952:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020ff600 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787734008.541956:0:11155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734008.541974:0:11155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787734008.541981:0:11155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734008.541987:0:11155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787734008.541989:0:11155:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787734008.541991:0:11155:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787734008.542026:0:11155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734008.542032:0:11155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787734008.542071:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705770240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787734008.542110:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734008.542204:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705770240 00000100:00100000:3.0:1787734008.542211:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705770240 00000100:00100000:3.0:1787734008.542250:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787734008.542258:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef0385c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3310:x1874574705770240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787734008.542265:0:5817:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787734008 with bad export cookie 4981699748219933337 00010000:00010000:0.0:1787734008.543994:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734008.544020:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020ff600/0x45228d86de4d55d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x45228d86de4d55da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734008.544037:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734008.544039:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734008.544041:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787734008.553355:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef0385c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3310:x1874574705770240:12345-0@lo:103:ldlm_bl.0 Request processed in 11088us (11236us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787734008.553369:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787734008.553489:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787734008.553495:0:3310:0:(import.c:65:import_set_state_nolock()) ffff891ec61d3000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787734008.553498:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787734008.556992:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.134@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787734008.556995:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787734008.557016:0:3310:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff891ec60c8a80 x1874574705770240/t0(0) o103->MGC192.168.201.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787734024 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787734008.557030:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787734008.557033:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787734008.557034:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787734008.557038:0:3310:0:(import.c:65:import_set_state_nolock()) ffff891ec61d3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787734008.557042:0:3310:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 125 00000100:00080000:1.0:1787734008.557050:0:3310:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import ffff891ec61d3000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787734008.557579:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891eeff2dc00 x1874574705770368/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787734008.557610:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df19622b-ae94-4c8d-b052-574898624480:3310:1874574705770240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787734008.557736:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df19622b-ae94-4c8d-b052-574898624480:3309:1874574705770368:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1787734008.557795:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874574705770368 offset 0 length 520: 4 00000100:00100000:2.0:1787734008.635285:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705770496:0@lo:400:kworker.0 00000400:00000100:2.0:1787734008.635344:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874574705770496 offset 0 length 224: 4 00010000:00010000:0.0:1787734009.274407:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734010.301506:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734011.322352:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734012.347674:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734013.370382:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787734013.754384:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) df19622b-ae94-4c8d-b052-574898624480->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787734013.754395:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) df19622b-ae94-4c8d-b052-574898624480->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787734013.754593:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787734013.754616:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705770624:0@lo:400:kworker.0 00000400:00000100:1.0:1787734013.754673:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874574705770624 offset 0 length 224: 4 00010000:00010000:0.0:1787734014.394329:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734015.420172:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734016.444134:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734017.468577:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734018.493922:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787734018.874286:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df19622b-ae94-4c8d-b052-574898624480->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787734018.874297:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) df19622b-ae94-4c8d-b052-574898624480->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787734018.874443:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705770752:0@lo:400:kworker.0 00000400:00000100:1.0:1787734018.874497:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874574705770752 offset 0 length 224: 4 00000100:00100000:0.0:1787734018.874640:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787734008/real 1787734008] req@ffff891eeff2dc00 x1874574705770368/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787734018 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787734018.874663:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff891eeff2dc00 x1874574705770368/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787734018 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787734018.874674:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787734008/real 1787734008] req@ffff891eeff2ea00 x1874574705770112/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787734018 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787734018.874686:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff891eeff2ea00 x1874574705770112/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787734018 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787734018.874697:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ec61d3000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787734018.874752:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787734018.874756:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df19622b-ae94-4c8d-b052-574898624480:3309:1874574705770368:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1787734018.874763:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891dc5655000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787734018.874776:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874574705770112:0@lo:39:umount.0 00000100:00080000:1.0:1787734018.874809:0:13201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787734018.874813:0:13201:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787734018.874853:0:13201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787734018.875771:0:13201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734018.875787:0:13201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734018.875795:0:13201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734018.875803:0:13201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734018.875840:0:13201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734018.875847:0:13201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734018.875868:0:13201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734018.875875:0:13201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734018.875881:0:13201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734018.875899:0:13201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787734018.875904:0:13201:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787734018.875926:0:13201:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787734018.875931:0:13201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787734018.875936:0:13201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787734018.875951:0:13201:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1787734018.875952:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:1.0:1787734018.875957:0:13201:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff891ef6c6cd28) has no exports 00010000:00010000:0.0:1787734018.875960:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734018.875971:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020ffa00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787734018.875975:0:11155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787734018.875983:0:13201:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff891ef6c6cd28) has no exports 00010000:00010000:0.0:1787734018.875985:0:11155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787734018.876006:0:11155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734018.876012:0:11155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787734018.876014:0:11155:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787734018.876017:0:11155:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787734018.876031:0:11155:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff891ec61d3000 00010000:00010000:0.0:1787734018.876035:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734018.876042:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020ffa00/0x45228d86de4d55e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d55e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734018.876056:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734018.876060:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734018.876066:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cda00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787734018.876069:0:11155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734018.876076:0:11155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787734018.876083:0:11155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734018.876089:0:11155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787734018.876091:0:11155:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787734018.876097:0:11155:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787734018.876103:0:11155:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff891ec61d3000 00010000:00010000:0.0:1787734018.876106:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734018.876113:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec60cda00/0x45228d86de4d57f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d57fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734018.876124:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734018.876126:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734018.876128:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734018.876880:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787734018.876988:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df19622b-ae94-4c8d-b052-574898624480->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787734018.876993:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787734018.877002:0:8:0:(import.c:65:import_set_state_nolock()) ffff891ec61d3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787734018.877007:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 326 00000100:00080000:3.0:1787734018.877012:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.134@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787734018.877016:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import ffff891ec61d3000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1787734018.877039:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891f018f9c00 x1874574705770880/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787734018.877083:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df19622b-ae94-4c8d-b052-574898624480:3309:1874574705770880:0@lo:250:kworker.0 00000400:00000100:0.0:1787734018.877129:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874574705770880 offset 0 length 520: 4 00000020:01000000:1.0:1787734018.877734:0:13201:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff891ef63c51e0 - data ffff891ec93686c0/ffff891eefda1800 00000020:01000000:1.0:1787734018.880791:0:13201:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff891dc573e600 - data ffff891ec9280a20/ffff891dc5754c00 00100000:10000000:1.0:1787734018.887562:0:13201:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787734018.910890:0:13201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d53bf 00000020:00000080:2.0:1787734018.910982:0:13201:0:(genops.c:885:class_export_put()) final put ffff891dc541d800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787734018.911058:0:13201:0:(tgt_mount.c:187:server_put_mount()) put mount ffff891ec73ed000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787734018.911062:0:13201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891ec73ed000 2 00000020:01000004:2.0:1787734018.911077:0:13201:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff891ec73ed000 from lustre-OST0000 00000020:00000080:2.0:1787734018.911115:0:13201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787734018.911124:0:13201:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787734018.911127:0:13201:0:(genops.c:885:class_export_put()) final put ffff891ef6c8c000/lustre-OST0000_UUID 00000020:00000080:2.0:1787734018.911130:0:13201:0:(genops.c:844:class_export_destroy()) destroying export ffff891ef6c8c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787734018.911140:0:13201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787734018.911205:0:13201:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787734018.911209:0:13201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787734018.911212:0:13201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787734018.911217:0:13201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787734018.911223:0:13201:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff891dc5654000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787734018.911230:0:13201:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff891ef0324d28) has exports, disconnecting them 00000020:00080000:2.0:1787734018.911234:0:13201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff891dc5654000), last request at 1787733824 00000020:00000080:2.0:1787734018.911239:0:13201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d53e9 00000020:00080000:2.0:1787734018.911247:0:13201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff891dc5654000): rc 0 00000020:00000080:2.0:1787734018.911251:0:13201:0:(genops.c:885:class_export_put()) final put ffff891dc5654000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787734018.911343:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891dc541d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787734018.911422:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891dc5654000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787734018.914211:0:13201:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787734018.914219:0:13201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787734018.914224:0:13201:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787734018.914230:0:13201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787734018.914419:0:13201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787734018.914428:0:13201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787734018.914434:0:13201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891ec73ed000 1 00000020:00000080:3.0:1787734018.914440:0:13201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5379 00000020:00000080:3.0:1787734018.914448:0:13201:0:(genops.c:885:class_export_put()) final put ffff891ec73ec800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787734018.914454:0:13201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787734018.914459:0:13201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787734018.914463:0:13201:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787734018.914467:0:13201:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff891ee56e99b8) has no exports 00000020:00000080:0.0:1787734018.914971:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891dc5655000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787734018.914978:0:8:0:(genops.c:885:class_export_put()) final put ffff891dc5654800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787734018.914981:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891dc5654800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787734018.914989:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787734018.915036:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec73ec800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787734018.927235:0:13201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787734018.927251:0:13201:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787734018.927257:0:13201:0:(genops.c:885:class_export_put()) final put ffff891ec73ec000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787734018.927262:0:13201:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec73ec000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787734018.927270:0:13201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787734018.927454:0:13201:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff891ec73ea800 00000020:02000400:3.0:1787734018.927507:0:13201:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787734019.515853:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734020.540010:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787734021.015512:0:13354:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787734021.021266:0:13354:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787734021.021337:0:13354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734021.021353:0:13354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734021.021373:0:13354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734021.021378:0:13354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734021.021394:0:13354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787734021.021399:0:13354:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787734021.021415:0:13354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787734021.021424:0:13354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff891f018fb100 x1874574705770496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734024 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787734021.021440:0:13354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff891ec60c8000 x1874574705770624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787734021.021462:0:13354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff891f018f8e00 x1874574705770752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787734021.021470:0:13354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787734021.021475:0:13354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787734021.021485:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705770496:0@lo:400:kworker.0 00000100:00080000:1.0:1787734021.021499:0:13354:0:(import.c:65:import_set_state_nolock()) ffff891f0184f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787734021.021562:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787734021.021566:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705770752:0@lo:400:kworker.0 00010000:00010000:0.0:1787734021.021569:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734021.021576:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020fe600 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787734021.021580:0:11155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734021.021587:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874574705770624:0@lo:400:kworker.0 00010000:00010000:0.0:1787734021.021589:0:11155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787734021.021604:0:11155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734021.021610:0:11155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787734021.021613:0:11155:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787734021.021615:0:11155:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787734021.021627:0:11155:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff891ec61d3000 00010000:00010000:0.0:1787734021.021630:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734021.021636:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020fe600/0x45228d86de4d55a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d55b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734021.021648:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734021.021650:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734021.021651:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787734021.021667:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874574705771008:0@lo:39:umount.0 00000400:00000100:0.0:1787734021.021711:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874574705771008 offset 0 length 224: 4 00010000:00010000:2.0:1787734021.562315:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734022.586276:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734023.611095:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787734023.994269:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df19622b-ae94-4c8d-b052-574898624480->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787734023.994278:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) df19622b-ae94-4c8d-b052-574898624480->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787734024.634479:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734025.658390:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734026.683539:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734027.706580:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734028.731771:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787734029.114850:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df19622b-ae94-4c8d-b052-574898624480->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787734029.114861:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) df19622b-ae94-4c8d-b052-574898624480->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787734029.754273:0:13048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734030.779701:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787734031.226789:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787734021/real 1787734021] req@ffff891eeff2ea00 x1874574705771008/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787734031 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787734031.226825:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff891eeff2ea00 x1874574705771008/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787734031 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787734031.226844:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891f0184f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787734031.226874:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874574705771008:0@lo:39:umount.0 00000100:00080000:1.0:1787734031.227176:0:13354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787734031.227181:0:13354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787734031.227186:0:13354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787734031.228146:0:13354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734031.228218:0:13354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734031.228226:0:13354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734031.228233:0:13354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734031.228263:0:13354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734031.228271:0:13354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734031.228278:0:13354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734031.228285:0:13354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734031.228291:0:13354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734031.228312:0:13354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787734031.228317:0:13354:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787734031.228337:0:13354:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787734031.228342:0:13354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787734031.228346:0:13354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787734031.228352:0:13354:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787734031.228357:0:13354:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff891ee56eb370) has no exports 00000020:00080000:1.0:1787734031.228390:0:13354:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff891ee56eb370) has no exports 00000020:01000000:1.0:1787734031.230040:0:13354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff891ed0b6c000 - data ffff891ec925f360/ffff891ef61b5000 00010000:00010000:0.0:1787734031.230574:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787734031.230584:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734031.230624:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020ff000 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787734031.230629:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734031.230639:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787734031.230646:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734031.230652:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787734031.230654:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787734031.230657:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787734031.230673:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff891ec61d3000 00010000:00010000:0.0:1787734031.230677:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734031.230684:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020ff000/0x45228d86de4d55b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d55be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734031.230694:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734031.230698:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734031.230703:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca600 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787734031.230706:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734031.230713:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787734031.230737:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734031.230743:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787734031.230745:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787734031.230747:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787734031.230754:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff891ec61d3000 00010000:00010000:0.0:1787734031.230757:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734031.230763:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec13ca600/0x45228d86de4d57e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d57e7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734031.230776:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734031.230778:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734031.230780:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734031.230843:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787734031.236078:0:13354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff891ef110d360 - data ffff891f01e8be58/ffff891dc6dc9400 00100000:10000000:1.0:1787734031.246101:0:13354:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787734031.286984:0:13354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5498 00000020:00000080:2.0:1787734031.286994:0:13354:0:(genops.c:885:class_export_put()) final put ffff891ec73ef000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787734031.287017:0:13354:0:(tgt_mount.c:187:server_put_mount()) put mount ffff891ef0329800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787734031.287021:0:13354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891ef0329800 2 00000020:01000004:2.0:1787734031.287024:0:13354:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff891ef0329800 from lustre-OST0001 00000020:00000080:2.0:1787734031.287048:0:13354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787734031.287058:0:13354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787734031.287061:0:13354:0:(genops.c:885:class_export_put()) final put ffff891f0184d000/lustre-OST0001_UUID 00000020:00000080:2.0:1787734031.287065:0:13354:0:(genops.c:844:class_export_destroy()) destroying export ffff891f0184d000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787734031.287071:0:13354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787734031.287234:0:13354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import df19622b-ae94-4c8d-b052-574898624480->MGS 00010000:00010000:2.0:1787734031.287266:0:13354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec0031600/0x45228d86de4d539c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d53a3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787734031.287279:0:13354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec0031600/0x45228d86de4d539c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d53a3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787734031.287286:0:13354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787734031.287289:0:13354:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787734031.287293:0:13354:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787734031.287309:0:13354:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff891ec61d3000 00010000:00010000:2.0:1787734031.287313:0:13354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec0031600/0x45228d86de4d539c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d53a3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734031.287331:0:13354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec13cb400/0x45228d86de4d5627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x45228d86de4d562e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787734031.287339:0:13354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec13cb400/0x45228d86de4d5627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x45228d86de4d562e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787734031.287344:0:13354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787734031.287346:0:13354:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787734031.287358:0:13354:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787734031.287369:0:13354:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff891ec61d3000 00010000:00010000:2.0:1787734031.287372:0:13354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec13cb400/0x45228d86de4d5627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x45228d86de4d562e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787734031.287390:0:13354:0:(import.c:65:import_set_state_nolock()) ffff891ec61d3000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787734031.287394:0:13354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787734031.287396:0:13354:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787734031.287398:0:13354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787734031.287402:0:13354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787734031.287424:0:13354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff891f018f9c00 x1874574705770880/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787734033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787734031.287443:0:13354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787734031.287445:0:13354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1787734031.287690:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df19622b-ae94-4c8d-b052-574898624480:3309:1874574705770880:0@lo:250:kworker.0 10000000:01000000:2.0:1787734031.287801:0:13354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787734031.287809:0:13354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d528b 00000020:00000080:2.0:1787734031.287814:0:13354:0:(genops.c:885:class_export_put()) final put ffff891ec8151000/df19622b-ae94-4c8d-b052-574898624480 00000020:01000000:2.0:1787734031.287819:0:13354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.134@tcp (flags='') 00000020:00000080:2.0:1787734031.287824:0:13354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787734031.287828:0:13354:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.134@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787734031.287832:0:13354:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff891ef03219b8) has no exports 10000000:01000000:1.0:1787734031.287963:0:5829:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787734031.288035:0:13354:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.134@tcp: client import never connected 00000100:00080000:2.0:1787734031.288038:0:13354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787734031.288040:0:13354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787734031.288042:0:13354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787734031.288044:0:13354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787734031.288075:0:13354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787734031.288079:0:13354:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.134@tcp (uuid df19622b-ae94-4c8d-b052-574898624480) 00000020:01000000:2.0:1787734031.288084:0:13354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787734031.288087:0:13354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787734031.288090:0:13354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787734031.288094:0:13354:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff891dc5656800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787734031.288110:0:13354:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff891ef0323370) has exports, disconnecting them 00000020:00080000:2.0:1787734031.288114:0:13354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff891dc5656800), last request at 1787733842 00000020:00000080:2.0:1787734031.288118:0:13354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d54c2 00000020:00080000:2.0:1787734031.288128:0:13354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff891dc5656800): rc 0 00000020:00000080:2.0:1787734031.288132:0:13354:0:(genops.c:885:class_export_put()) final put ffff891dc5656800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787734031.289245:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec73ef000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787734031.289265:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec8151000/df19622b-ae94-4c8d-b052-574898624480 for MGC192.168.201.134@tcp 00000020:00000080:0.0:1787734031.289271:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891ec61d3000 for MGC192.168.201.134@tcp 00000020:00000080:0.0:1787734031.289276:0:8:0:(genops.c:885:class_export_put()) final put ffff891ec3384000/df19622b-ae94-4c8d-b052-574898624480 00000020:00000080:0.0:1787734031.289279:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec3384000/df19622b-ae94-4c8d-b052-574898624480 for MGC192.168.201.134@tcp 00000020:01000000:0.0:1787734031.289283:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.134@tcp (df19622b-ae94-4c8d-b052-574898624480) 00000020:00000080:0.0:1787734031.289552:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891dc5656800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787734031.290615:0:13354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787734031.290621:0:13354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787734031.290626:0:13354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787734031.290633:0:13354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787734031.290714:0:13048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787734031.290812:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787734031.290882:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1787734031.290958:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1787734031.291046:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff891ed8e32e00:5816] 1 exiting: rc = 0 00000100:00100000:1.0:1787734031.291292:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff891ed8e33c00:5815] 0 exiting: rc = 1 00000020:00000080:1.0:1787734031.291338:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff891f0184f000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:0.0:1787734031.293389:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.293734:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff891ee5614600:5818] 1 exiting: rc = 0 00000100:00100000:1.0:1787734031.294020:0:11156:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff891ec2a92400:11156] 4 exiting: rc = 0 00000100:00100000:1.0:1787734031.294095:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff891ee5615600:5819] 2 exiting: rc = 0 00000100:00100000:1.0:1787734031.294210:0:7616:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff891efe568400:7616] 3 exiting: rc = 0 00000100:00100000:3.0:1787734031.296970:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff891ee5614a00:5817] 0 exiting: rc = 1 00000100:00100000:0.0:1787734031.297288:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297297:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297305:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297311:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297318:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297323:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297329:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297335:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297342:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297347:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297352:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297358:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297365:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297371:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297377:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297384:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297390:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297397:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297402:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297407:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297412:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297430:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297436:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297442:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297447:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297453:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297458:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297477:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297482:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297488:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297495:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297500:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297506:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297512:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297517:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297523:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297528:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297533:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297539:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297544:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297550:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297555:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297561:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297566:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297572:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297589:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297594:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297600:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297615:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297622:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297628:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297633:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297638:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297643:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297656:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297662:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297667:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297672:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297677:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297682:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297687:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297693:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297704:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787734031.297710:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787734031.299496:0:13354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787734031.299508:0:13354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787734031.299514:0:13354:0:(genops.c:885:class_export_put()) final put ffff891f0184a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787734031.299519:0:13354:0:(genops.c:844:class_export_destroy()) destroying export ffff891f0184a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787734031.299525:0:13354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787734031.299583:0:13354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891ef0329800 1 00000020:00000080:0.0:1787734031.299590:0:13354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x45228d86de4d5467 00000020:00000080:0.0:1787734031.299597:0:13354:0:(genops.c:885:class_export_put()) final put ffff891ec6c83000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787734031.299618:0:13354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787734031.299623:0:13354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787734031.299628:0:13354:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787734031.299632:0:13354:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff891ef64ab370) has no exports 00000020:00000080:1.0:1787734031.300139:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec6c83000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787734031.334909:0:13354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787734031.334926:0:13354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787734031.334941:0:13354:0:(genops.c:885:class_export_put()) final put ffff891ec6d33800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787734031.334946:0:13354:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec6d33800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787734031.334952:0:13354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787734031.335143:0:13354:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff891ef032f000 00000020:01000000:1.0:1787734031.335189:0:13354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787734031.335194:0:13354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787734031.335199:0:13354:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787734031.335203:0:13354:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff891ee56ecd28) has no exports 00000020:00000080:1.0:1787734031.335229:0:13354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787734031.335235:0:13354:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787734031.335239:0:13354:0:(genops.c:885:class_export_put()) final put ffff891ec73ee000/OSS_uuid 00000020:00000080:1.0:1787734031.335241:0:13354:0:(genops.c:844:class_export_destroy()) destroying export ffff891ec73ee000/OSS_uuid for OSS 00000020:01000000:1.0:1787734031.335245:0:13354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787734031.335320:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff891ed205fe00:6679] 0 exiting: rc = 1 00000100:00100000:1.0:1787734031.335424:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff891ef1368400:6681] 1 exiting: rc = 0 00000100:00080000:3.0:1787734031.335750:0:5828:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787734031.336975:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff891ef0257c00:6682] 2 exiting: rc = 0 00000100:00100000:2.0:1787734031.337047:0:12052:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff891ec3324600:12052] 4 exiting: rc = 0 00000100:00100000:1.0:1787734031.338263:0:6729:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff891dc5416e00:6729] 3 exiting: rc = 0 00000100:00100000:1.0:1787734031.338368:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338384:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338392:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338398:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338403:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338409:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338414:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338420:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338425:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338430:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338436:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338442:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338447:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338452:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338458:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338463:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338468:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338473:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338478:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338484:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338489:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338495:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338500:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338505:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338510:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338516:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338524:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338529:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338534:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338540:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338546:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338550:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338555:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338560:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338566:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338594:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338599:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338616:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338621:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338627:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338635:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338641:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338656:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338662:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338667:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338672:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338677:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338682:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338687:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338693:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338698:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338703:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338708:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338713:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338718:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338723:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338729:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338734:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338740:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338745:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338751:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338756:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338762:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.338767:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.339598:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff891ef6974e00:6683] 0 exiting: rc = 1 00000100:00100000:1.0:1787734031.350653:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff891ef6975e00:6684] 1 exiting: rc = 0 00000100:00100000:1.0:1787734031.350788:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350795:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350801:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350807:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350825:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350831:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350836:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350841:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350847:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350868:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350875:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350880:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350885:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350890:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350895:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350901:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350906:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350911:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350917:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350923:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350928:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350933:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350938:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350944:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350950:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350956:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350961:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350966:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350971:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350977:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350983:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350987:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350993:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.350999:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351004:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351009:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351014:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351020:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351025:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351039:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351046:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351051:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351056:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351061:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351066:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351071:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351077:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351082:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351090:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351097:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351102:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351108:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351119:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351127:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351132:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351138:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351143:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351149:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351173:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351181:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351187:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351192:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351199:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.351204:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.357504:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff891ef6977a00:6687] 2 exiting: rc = 0 00000100:00100000:1.0:1787734031.360210:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff891ef6976400:6686] 1 exiting: rc = 0 00000100:00100000:2.0:1787734031.361283:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff891ef6977e00:6685] 0 exiting: rc = 1 00000100:00100000:1.0:1787734031.361482:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361491:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361498:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361506:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361513:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361521:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361527:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361533:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361553:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361558:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361563:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361570:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361576:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361582:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361587:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361593:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361599:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361615:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361622:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361629:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361636:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361643:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361649:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361655:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361661:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361666:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361672:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361712:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361720:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361736:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361742:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361747:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361753:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361759:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361765:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361772:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361778:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361783:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361790:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361795:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361800:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361805:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361811:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361824:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361829:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361835:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361841:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361847:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361852:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361869:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361874:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361895:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361902:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361907:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361912:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361918:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361924:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361930:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361936:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361951:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361958:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361964:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361970:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.361976:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.386666:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff891ef6976000:6689] 1 exiting: rc = 0 00000100:00100000:3.0:1787734031.388137:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff891ef6977000:6688] 0 exiting: rc = 1 00000100:00100000:1.0:1787734031.388318:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388327:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388333:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388339:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388344:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388349:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388354:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388359:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388364:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388370:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388375:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388381:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388386:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388403:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.388408:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389027:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389037:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389042:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389047:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389052:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389057:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389061:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389066:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389071:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389076:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389080:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389084:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389089:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389094:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389098:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389104:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389108:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389113:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389118:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389123:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389128:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389133:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389139:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389144:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389149:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389184:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389192:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389197:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389202:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389207:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389212:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389217:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389221:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389236:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389240:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389246:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389251:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389256:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389261:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389266:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389272:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389277:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389282:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389287:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389293:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389298:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389303:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389307:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.389312:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.392959:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff891ef6958400:6690] 0 exiting: rc = 1 00000100:00100000:1.0:1787734031.393068:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff891ef6959a00:6691] 1 exiting: rc = 0 00000100:00100000:1.0:1787734031.393129:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393147:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393172:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393180:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393187:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393193:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393201:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393207:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393214:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393220:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393226:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393232:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393239:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393259:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393268:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393275:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393281:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393302:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393308:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393315:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393322:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393328:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393334:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393340:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393348:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393370:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393378:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393386:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393393:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393400:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393406:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393413:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393419:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393425:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393432:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393438:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393443:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393449:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393467:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393474:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393480:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393487:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393493:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393499:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393505:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393510:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393516:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393522:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393529:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393535:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393556:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393563:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393576:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393582:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393588:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393593:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393599:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393619:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393628:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393633:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393639:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393645:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393666:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787734031.393673:0:13354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787734031.429266:0:13354:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787734044.429930:0:13971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787734052.002192:0:14433:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787734052.002199:0:14433:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787734052.002423:0:14433:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff891efe936000 00000020:01000004:0.0:1787734052.002438:0:14433:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787734052.002446:0:14433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787734052.002461:0:14433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff891ef0323370) 00000020:00000080:0.0:1787734052.002474:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787734052.021941:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787734052.029949:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1787734052.030663:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 355: rc = 0 00100000:10000000:1.0:1787734052.030839:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787734052.030962:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 355: rc = 0 00100000:10000000:1.0:1787734052.031107:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 355: rc = 0 00100000:10000000:1.0:1787734052.031477:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 355: rc = 0 00100000:10000000:1.0:1787734052.031668:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 355: rc = 0 00100000:10000000:1.0:1787734052.031755:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 355: rc = 0 00100000:10000000:1.0:1787734052.032102:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 357: rc = 0 00100000:10000000:1.0:1787734052.033831:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 572: rc = 0 00100000:10000000:1.0:1787734052.034720:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 572: rc = 0 00100000:10000000:1.0:1787734052.036306:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 772: rc = 0 00100000:10000000:1.0:1787734052.038703:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:1.0:1787734052.039655:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 772: rc = 0 00100000:10000000:1.0:1787734052.039997:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:0.0:1787734052.040929:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:0.0:1787734052.041943:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1787734052.042986:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 772: rc = 0 00100000:10000000:0.0:1787734052.045760:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1787734052.046311:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 772: rc = 0 00100000:10000000:0.0:1787734052.046845:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1787734052.047663:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 772: rc = 0 00100000:10000000:0.0:1787734052.048012:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1787734052.049652:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 651: rc = 0 00100000:10000000:0.0:1787734052.050141:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 651: rc = 0 00100000:10000000:0.0:1787734052.050706:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 651: rc = 0 00100000:10000000:0.0:1787734052.051650:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 651: rc = 0 00100000:10000000:0.0:1787734052.051985:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 651: rc = 0 00100000:10000000:0.0:1787734052.052627:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 651: rc = 0 00100000:10000000:0.0:1787734052.052952:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 651: rc = 0 00100000:10000000:0.0:1787734052.053676:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 651: rc = 0 00100000:10000000:0.0:1787734052.053984:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 651: rc = 0 00100000:10000000:0.0:1787734052.054654:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 651: rc = 0 00100000:10000000:0.0:1787734052.054999:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 651: rc = 0 00100000:10000000:0.0:1787734052.055723:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 651: rc = 0 00100000:10000000:0.0:1787734052.056188:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 651: rc = 0 00100000:10000000:0.0:1787734052.056791:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 651: rc = 0 00100000:10000000:2.0:1787734052.057791:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 651: rc = 0 00100000:10000000:2.0:1787734052.058326:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 651: rc = 0 00100000:10000000:2.0:1787734052.059219:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 651: rc = 0 00100000:10000000:2.0:1787734052.059940:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 651: rc = 0 00100000:10000000:2.0:1787734052.060517:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 651: rc = 0 00100000:10000000:2.0:1787734052.061490:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 651: rc = 0 00100000:10000000:2.0:1787734052.062085:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 651: rc = 0 00100000:10000000:2.0:1787734052.062614:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 651: rc = 0 00100000:10000000:2.0:1787734052.063544:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 651: rc = 0 00100000:10000000:2.0:1787734052.063800:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 651: rc = 0 00100000:10000000:2.0:1787734052.064486:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 651: rc = 0 00100000:10000000:2.0:1787734052.064829:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 651: rc = 0 00100000:10000000:2.0:1787734052.065695:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 651: rc = 0 00100000:10000000:2.0:1787734052.066013:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 651: rc = 0 00100000:10000000:2.0:1787734052.067141:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 651: rc = 0 00100000:10000000:2.0:1787734052.067787:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 651: rc = 0 00100000:10000000:2.0:1787734052.068304:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 651: rc = 0 00100000:10000000:2.0:1787734052.068822:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 651: rc = 0 00100000:10000000:2.0:1787734052.069772:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 586: rc = 0 00100000:10000000:2.0:1787734052.071149:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787734052.071749:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 576: rc = 0 00100000:10000000:2.0:1787734052.072019:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787734052.072150:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 576: rc = 0 00100000:10000000:2.0:1787734052.072653:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787734052.072721:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 576: rc = 0 00100000:10000000:2.0:1787734052.073637:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787734052.073719:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 573: rc = 0 00100000:10000000:2.0:1787734052.074012:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787734052.074181:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 573: rc = 0 00100000:10000000:2.0:1787734052.074986:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787734052.075145:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 573: rc = 0 00000020:00000080:2.0:1787734052.075927:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787734052.075936:0:14433:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787734052.075948:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d658c 00000020:01000004:2.0:1787734052.075956:0:14433:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787734052.075961:0:14433:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787734052.075966:0:14433:0:(tgt_mount.c:101:server_register_mount()) register mount ffff891efe936000 from MGS 00000020:01000004:2.0:1787734052.075970:0:14433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787734052.075980:0:14433:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff891ee57b99b8) 00000020:00000080:2.0:1787734052.075989:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787734052.076116:0:14433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891efe936000 from MGS, refs=2 00080000:01000000:2.0:1787734052.076122:0:14433:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787734052.076127:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d659a 00000100:00100000:2.0:1787734052.076329:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787734052.076701:0:14433:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787734052.076706:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787734052.077957:0:14433:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787734052.077966:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787734052.078994:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787734052.080810:0:14433:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787734052.080818:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787734052.081836:0:14433:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787734052.081844:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787734052.082262:0:14433:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787734052.082342:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787734052.082990:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734052.082998:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734052.083001:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734052.084519:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734052.084523:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734052.084526:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734052.085256:0:14433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787734052.091139:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787734052.115006:0:14433:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787734052.115039:0:14433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787734052.115042:0:14433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787734052.119189:0:14442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787734052.119462:0:14433:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787734052.119883:0:14433:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787734052.121943:0:14433:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787734052.125348:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787734052.126719:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787734052.126730:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787734052.129817:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787734052.129830:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787734052.130928:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787734052.130938:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787734052.140997:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787734052.141021:0:14433:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.134@tcp' 00000020:01000004:1.0:1787734052.141023:0:14433:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787734052.141066:0:14433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.134@tcp (typ=mgc) 00000020:00000080:1.0:1787734052.141078:0:14433:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.134@tcp (ffff891ef6c6b370) 00000020:00000080:1.0:1787734052.141093:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787734052.141185:0:14433:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891ef5d4a000@MGC192.168.201.134@tcp: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1787734052.141350:0:14433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.134@tcp-0 is initialized 00000040:01000000:1.0:1787734052.141369:0:14433:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787734052.143516:0:14448:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787734052.143713:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.134@tcp (uuid 8bc5a29a-c0a9-4a8d-a0aa-316066d4be06) 00000020:00000080:1.0:1787734052.143737:0:14433:0:(genops.c:1385:class_connect()) connect: client 8bc5a29a-c0a9-4a8d-a0aa-316066d4be06, cookie 0x45228d86de4d65a8 00000100:00080000:1.0:1787734052.143750:0:14433:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787734052.143757:0:14433:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import ffff891ef5d4a000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787734052.143791:0:14433:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891eeff2f800 x1874574705771136/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787734052.143834:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3309:1874574705771136:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787734052.143911:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787734052.143981:0:14433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8bc5a29a-c0a9-4a8d-a0aa-316066d4be06->MGS 00000020:01000004:1.0:1787734052.144007:0:14433:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787734052.144021:0:14433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787734052.144037:0:14433:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff891ef6c68000) 00000020:00000080:1.0:1787734052.144048:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787734052.146040:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705771136 00000100:00100000:0.0:1787734052.146053:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705771136 00000100:00100000:0.0:1787734052.146089:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787734052.146098:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874574705771136:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787734052.146124:0:14444:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8bc5a29a-c0a9-4a8d-a0aa-316066d4be06@0@lo t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:0.0:1787734052.146176:0:14444:0:(genops.c:1385:class_connect()) connect: client 8bc5a29a-c0a9-4a8d-a0aa-316066d4be06, cookie 0x45228d86de4d65b6 00000100:00080000:0.0:1787734052.146337:0:14444:0:(import.c:65:import_set_state_nolock()) ffff891efe932000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787734052.146995:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+5:3309:x1874574705771136:12345-0@lo:250:mount.lustre.0 Request processed in 894us (3081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734052.147012:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787734052.147072:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787734052.147081:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.134@tcp: connect to target with instance 0 00000100:00080000:0.0:1787734052.147088:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787734052.147093:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787734052.147095:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ef5d4a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787734052.147098:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787734052.147101:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787734052.147105:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3309:1874574705771136:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1787734052.161214:0:14447:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1787734052.179119:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787734052.180886:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787734052.180894:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787734052.184687:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787734052.184703:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787734052.185694:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787734052.185704:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787734052.188749:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787734052.189827:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787734052.189836:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787734052.191142:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787734052.191152:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787734052.254012:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787734052.254513:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787734052.254522:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787734052.256681:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787734052.256694:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787734052.258107:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787734052.258693:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787734052.258699:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787734052.259687:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787734052.259695:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787734052.260476:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787734052.260736:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787734052.260740:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787734052.261772:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787734052.261779:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787734052.262754:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787734052.262985:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787734052.262991:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787734052.263947:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787734052.263956:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787734052.293706:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787734052.294454:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787734052.294462:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787734052.297972:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787734052.297990:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787734052.299389:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787734052.299401:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787734052.302105:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787734052.302136:0:14433:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787734052.302144:0:14433:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787734052.302634:0:14433:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787734052.302672:0:14433:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787734052.302731:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787734052.302733:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787734052.302735:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787734052.302736:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787734052.302737:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787734052.302738:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787734052.302740:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787734052.302741:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787734052.302743:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787734052.302744:0:14433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787734052.302747:0:14433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787734052.302749:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787734052.302751:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787734052.302752:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787734052.302753:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787734052.302754:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787734052.302756:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787734052.302756:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787734052.302758:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787734052.302759:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787734052.302760:0:14433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787734052.302788:0:14433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787734052.302811:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771264:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787734052.302956:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734052.303065:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0ba93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787734052.303579:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705771264 00000100:00100000:3.0:1787734052.303587:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705771264 00000100:00100000:3.0:1787734052.303671:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787734052.303692:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+5:14433:x1874574705771264:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787734052.303727:0:14446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787734052.303729:0:14446:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787734052.303732:0:14446:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787734052.304268:0:14467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787734052.304671:0:14446:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787734052.306559:0:14468:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787734052.306570:0:14468:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787734052.306574:0:14468:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787734052.306615:0:14468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787734052.306920:0:14446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787734052.306931:0:14446:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787734052.324743:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+5:14433:x1874574705771264:12345-0@lo:253:mount.lustre.0 Request processed in 21053us (21777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734052.324760:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787734052.325036:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771264:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787734052.325068:0:14433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787734052.325071:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787734052.325073:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787734052.325074:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787734052.325075:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787734052.325076:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787734052.325077:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787734052.325079:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787734052.325081:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787734052.325082:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787734052.325084:0:14433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787734052.325111:0:14433:0:(tgt_mount.c:101:server_register_mount()) register mount ffff891efe936000 from lustre-MDT0000 10000000:01000000:1.0:1787734052.325136:0:14433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787734052.325140:0:14433:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787734052.325144:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff891ef6c6b370 10000000:01000000:1.0:1787734052.325149:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787734052.325173:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff891ef6c6b370 from 1 10000000:01000000:1.0:1787734052.325176:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787734052.325675:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734052.325690:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734052.325699:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734052.325790:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787734052.325840:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734052.325891:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787734052.326006:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705771392 00000100:00100000:1.0:1787734052.326013:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705771392 00000100:00100000:1.0:1787734052.326071:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787734052.326080:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+5:14433:x1874574705771392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787734052.326093:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787734052.326108:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cd200/0x45228d86de4d65c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d65bd expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734052.326138:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cd200/0x45228d86de4d65c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d65bd expref: 6 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734052.326148:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cd200/0x45228d86de4d65c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d65bd expref: 6 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734052.326192:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cd200, rc 0) 00000100:00100000:3.0:1787734052.326340:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787734052.326366:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65c4 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.326384:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d65c4 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734052.326437:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734052.327797:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734052.327893:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0adb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787734052.328198:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+6:14433:x1874574705771392:12345-0@lo:101:mount.lustre.0 Request processed in 2117us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734052.328207:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787734052.328264:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705771520 00000100:00100000:1.0:1787734052.328271:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705771520 00000100:00100000:2.0:1787734052.328720:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787734052.328733:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+6:14433:x1874574705771520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787734052.329346:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+6:14433:x1874574705771520:12345-0@lo:501:mount.lustre.0 Request processed in 615us (1553us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787734052.329521:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771520:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787734052.329671:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787734052.329704:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65c4 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.329714:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65c4 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734052.329723:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff891efe936000 10000000:01000000:3.0:1787734052.329729:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787734052.329733:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff891efe936000 10000000:01000000:3.0:1787734052.329735:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787734052.329739:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff891efe936000 from 1 10000000:01000000:3.0:1787734052.329741:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787734052.329767:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d65cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.329775:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d65cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.329793:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d65cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734052.329811:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787734052.329843:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734052.329881:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0adb540 going to sleep for 11 seconds 00000100:00100000:2.0:1787734052.330145:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787734052.330198:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705771648 00000100:00100000:2.0:1787734052.330202:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705771648 00000100:00100000:2.0:1787734052.330304:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787734052.330312:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+6:14433:x1874574705771648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787734052.330322:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734052.330337:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ef6b61a00/0x45228d86de4d65d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d65cb expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.330367:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ef6b61a00/0x45228d86de4d65d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d65cb expref: 7 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.330501:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ef6b61a00/0x45228d86de4d65d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d65cb expref: 7 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.330510:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ef6b61a00, rc 0) 00000100:00100000:2.0:1787734052.330660:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+7:14433:x1874574705771648:12345-0@lo:101:mount.lustre.0 Request processed in 348us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734052.330676:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787734052.331955:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787734052.331977:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d65cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65d2 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.331987:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d65cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d65d2 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734052.332003:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787734052.332028:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d65cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65d2 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.332036:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c1000/0x45228d86de4d65cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65d2 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734052.332042:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787734052.332048:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787734052.332199:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff891efe936000 10000000:01000000:3.0:1787734052.332203:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787734052.332207:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787734052.332209:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787734052.332255:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d65d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.332274:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d65d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.332284:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d65d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734052.332302:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787734052.332346:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734052.332602:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0adb540 going to sleep for 11 seconds 00000100:00100000:2.0:1787734052.332826:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705771776 00000100:00100000:2.0:1787734052.332833:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705771776 00000100:00100000:2.0:1787734052.332949:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787734052.332958:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+7:14433:x1874574705771776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787734052.332970:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734052.332983:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ef6b61000/0x45228d86de4d65e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d65d9 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.333004:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ef6b61000/0x45228d86de4d65e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d65d9 expref: 8 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.333013:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ef6b61000/0x45228d86de4d65e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d65d9 expref: 8 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.333214:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ef6b61000, rc 0) 00000100:00100000:2.0:1787734052.333328:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+8:14433:x1874574705771776:12345-0@lo:101:mount.lustre.0 Request processed in 370us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734052.333334:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787734052.333508:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787734052.333521:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d65d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65e0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.333530:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d65d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d65e0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734052.333700:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734052.333728:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734052.333957:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0adb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787734052.334002:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705771904 00000100:00100000:1.0:1787734052.334007:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705771904 00000100:00100000:1.0:1787734052.334055:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787734052.334064:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+8:14433:x1874574705771904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787734052.334543:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+9:14433:x1874574705771904:12345-0@lo:501:mount.lustre.0 Request processed in 470us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734052.334552:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787734052.334917:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705771904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734052.334953:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705772032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787734052.334994:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734052.335025:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0adb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787734052.335296:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705772032 00000100:00100000:1.0:1787734052.335301:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705772032 00000100:00100000:1.0:1787734052.335324:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787734052.335331:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+9:14433:x1874574705772032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787734052.335932:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+9:14433:x1874574705772032:12345-0@lo:503:mount.lustre.0 Request processed in 600us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734052.335940:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787734052.336668:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705772032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787734052.337303:0:14469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14469:1874574705772160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787734052.337377:0:14469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734052.337410:0:14469:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787734052.337772:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705772160 00000100:00100000:1.0:1787734052.337779:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705772160 00000100:00100000:1.0:1787734052.337823:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787734052.337832:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+9:14469:x1874574705772160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787734052.338760:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+9:14469:x1874574705772160:12345-0@lo:502:llog_process_th.0 Request processed in 927us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734052.338770:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787734052.339007:0:14469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14469:1874574705772160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787734052.339296:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787734052.339308:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787734052.339310:0:14469:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787734052.339316:0:14469:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787734052.339319:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787734052.339334:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff891ef64acd28) 00000020:00000080:3.0:1787734052.339467:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787734052.339475:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787734052.339668:0:14469:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787734052.339675:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d65ee 00000020:00000080:3.0:1787734052.339952:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787734052.339957:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787734052.339962:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787734052.339963:0:14469:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787734052.339966:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787734052.339970:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787734052.339971:0:14469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787734052.339975:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787734052.339982:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff891ef64a8000) 00000020:00000080:3.0:1787734052.339991:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787734052.339996:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787734052.339998:0:14469:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787734052.340000:0:14469:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787734052.340006:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787734052.340642:0:14469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891efe936000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787734052.340657:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff891ef03219b8) 00000020:00000080:0.0:1787734052.340666:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787734052.340730:0:14469:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787734052.340738:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45228d86de4d6603 00000020:00000080:0.0:1787734052.340837:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787734052.340843:0:14469:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787734052.340847:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x45228d86de4d660a 00080000:01000000:0.0:1787734052.340851:0:14469:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787734052.341476:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d6611 00010000:00010000:3.0:1787734052.449032:0:14469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787734052.450655:0:14469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787734052.450879:0:14469:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787734052.452686:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff891ef64ab370) 00000020:00000080:3.0:1787734052.452711:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787734052.452783:0:14469:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787734052.452790:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d661f 00000020:00000080:3.0:1787734052.456887:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787734052.475594:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x45228d86de4d6626 00000020:00000080:0.0:1787734052.476030:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787734052.476042:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787734052.476058:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.476065:0:14469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787734052.476070:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787734052.476077:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.476078:0:14469:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787734052.476082:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787734052.476120:0:14469:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787734052.476134:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787734052.476138:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.476139:0:14469:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787734052.476142:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787734052.476143:0:14469:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787734052.476145:0:14469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787734052.476146:0:14469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787734052.476148:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787734052.476150:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.476151:0:14469:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787734052.476182:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787734052.476186:0:14469:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787734052.476190:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.476192:0:14469:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787734052.476195:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787734052.476200:0:14469:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:0.0:1787734052.476244:0:14469:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787734052.476247:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787734052.476260:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff891ef0324d28) 00000020:00000080:0.0:1787734052.476272:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787734052.476277:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787734052.476332:0:14469:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787734052.476338:0:14469:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787734052.476343:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d6634 00010000:00080000:0.0:1787734052.476404:0:14469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891efee5c800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1787734052.476643:0:14469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787734052.478124:0:14469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787734052.479038:0:14469:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787734052.481990:0:14469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787734052.482091:0:14469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787734052.482936:0:14469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787734052.484744:0:14473:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787734052.484751:0:14473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787734052.486982:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787734052.486999:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787734052.487299:0:14469:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787734052.487323:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45228d86de4d663b 00000100:00080000:0.0:1787734052.487335:0:14469:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787734052.487341:0:14469:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff891efee5c800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1787734052.487643:0:14469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891ec60c9c00 x1874574705772288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787734052.487677:0:14469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787734052.487771:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705772288:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787734052.487827:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874574705772288 offset 0 length 520: 4 00000020:01000000:0.0:1787734052.487978:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787734052.487983:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.487984:0:14469:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787734052.487987:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787734052.487989:0:14469:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787734052.487991:0:14469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787734052.487992:0:14469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787734052.487994:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787734052.487996:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.487997:0:14469:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787734052.487999:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787734052.488003:0:14469:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787734052.488006:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.488008:0:14469:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787734052.488010:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787734052.488014:0:14469:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:0.0:1787734052.488041:0:14469:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787734052.488044:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787734052.488069:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff891ef0320000) 00000020:00000080:0.0:1787734052.488081:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787734052.488086:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787734052.488139:0:14469:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787734052.488144:0:14469:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787734052.488151:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45228d86de4d6649 00010000:00080000:0.0:1787734052.488203:0:14469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891ec6320800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1787734052.488436:0:14469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787734052.488610:0:14469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787734052.488634:0:14469:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787734052.489119:0:14469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787734052.489223:0:14469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787734052.489297:0:14469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787734052.490470:0:14475:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787734052.490480:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787734052.493749:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787734052.494810:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787734052.494931:0:14469:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787734052.494959:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45228d86de4d6650 00000100:00080000:0.0:1787734052.494971:0:14469:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787734052.494977:0:14469:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff891ec6320800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1787734052.495027:0:14469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891ec60c9880 x1874574705772416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787734052.495062:0:14469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787734052.495232:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787734052.495247:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.495250:0:14469:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787734052.495254:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787734052.495258:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.495260:0:14469:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787734052.495263:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787734052.495265:0:14469:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787734052.495268:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787734052.495270:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.495287:0:14469:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787734052.495290:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787734052.495293:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.495294:0:14469:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787734052.495299:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787734052.495339:0:14469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14469:1874574705772544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787734052.495456:0:14469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734052.495512:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705772544 00000100:00100000:0.0:1787734052.495520:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705772544 00000100:00100000:0.0:1787734052.495560:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787734052.495570:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+9:14469:x1874574705772544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787734052.495807:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+9:14469:x1874574705772544:12345-0@lo:502:llog_process_th.0 Request processed in 237us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734052.495815:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787734052.496438:0:14469:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37780 going to sleep for 11 seconds 00000100:00100000:0.0:1787734052.496467:0:14469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14469:1874574705772544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787734052.496515:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787734052.496522:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734052.496524:0:14469:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787734052.496529:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787734052.496626:0:14433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787734052.496652:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787734052.496670:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d65d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65e0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.496683:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c0e00/0x45228d86de4d65d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65e0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734052.496691:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff891efe936000 from 1 10000000:01000000:0.0:1787734052.496702:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787734052.496741:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.496749:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.496758:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734052.496775:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705772672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787734052.496816:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734052.496835:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37780 going to sleep for 11 seconds 00000100:00100000:1.0:1787734052.497405:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705772416:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787734052.497442:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874574705772416 offset 0 length 520: 4 00000100:00100000:1.0:1787734052.497647:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705772672 00000100:00100000:1.0:1787734052.497654:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705772672 00000100:00100000:1.0:1787734052.497709:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787734052.497719:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+9:14433:x1874574705772672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787734052.497733:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787734052.497750:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cdc00/0x45228d86de4d665e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d6657 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734052.497773:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cdc00/0x45228d86de4d665e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d6657 expref: 10 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734052.497783:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cdc00/0x45228d86de4d665e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d6657 expref: 10 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734052.497806:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cdc00, rc 0) 00000100:00100000:1.0:1787734052.497847:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+10:14433:x1874574705772672:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734052.497866:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787734052.499577:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705772672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787734052.499608:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.499621:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734052.501460:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705772800:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787734052.501555:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734052.501891:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705772800 00000100:00100000:1.0:1787734052.501901:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705772800 00000100:00100000:0.0:1787734052.502495:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37780 going to sleep for 11 seconds 00000100:00100000:1.0:1787734052.502752:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787734052.502765:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+10:14433:x1874574705772800:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787734052.502786:0:14445:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787734052.502793:0:14445:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787734052.502970:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+10:14433:x1874574705772800:12345-0@lo:256:mount.lustre.0 Request processed in 208us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734052.502979:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787734052.503066:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705772800:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787734052.504225:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787734052.504259:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.504287:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734052.504296:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891efe936000 from 1 10000000:01000000:0.0:1787734052.504300:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787734052.504334:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.504341:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.504464:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734052.504553:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705772928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787734052.504604:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734052.505762:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37780 going to sleep for 11 seconds 00000100:00100000:2.0:1787734052.505845:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705772928 00000100:00100000:2.0:1787734052.505863:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705772928 00000100:00100000:2.0:1787734052.505908:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787734052.505916:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+10:14433:x1874574705772928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787734052.505930:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734052.505948:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ef6b61e00/0x45228d86de4d666c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d6665 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.505989:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ef6b61e00/0x45228d86de4d666c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d6665 expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.505999:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ef6b61e00/0x45228d86de4d666c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d6665 expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.506007:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ef6b61e00, rc 0) 00000100:00100000:2.0:1787734052.506402:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14433:x1874574705772928:12345-0@lo:101:mount.lustre.0 Request processed in 485us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734052.506410:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787734052.506716:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705772928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787734052.506734:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.506744:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734052.506814:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705773056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787734052.506844:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734052.506882:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec596d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787734052.506993:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705773056 00000100:00100000:3.0:1787734052.507000:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705773056 00000100:00100000:3.0:1787734052.507040:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787734052.507059:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14433:x1874574705773056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734052.507868:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14433:x1874574705773056:12345-0@lo:501:mount.lustre.0 Request processed in 819us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734052.507877:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787734052.508328:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705773056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787734052.508557:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705773184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787734052.508605:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734052.508642:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec596d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787734052.508701:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705773184 00000100:00100000:3.0:1787734052.508706:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705773184 00000100:00100000:3.0:1787734052.508731:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787734052.508739:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14433:x1874574705773184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787734052.508974:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14433:x1874574705773184:12345-0@lo:503:mount.lustre.0 Request processed in 236us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734052.508981:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787734052.509199:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705773184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787734052.510677:0:14477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14477:1874574705773312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787734052.510734:0:14477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734052.510809:0:14477:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec596d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787734052.510910:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705773312 00000100:00100000:3.0:1787734052.510917:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705773312 00000100:00100000:3.0:1787734052.510994:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787734052.511004:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14477:x1874574705773312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787734052.511694:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14477:x1874574705773312:12345-0@lo:502:llog_process_th.0 Request processed in 691us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734052.511705:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787734052.511943:0:14477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14477:1874574705773312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787734052.511979:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787734052.511989:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734052.511992:0:14477:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787734052.511999:0:14477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891efe936000 00000020:00000080:2.0:1787734052.512003:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787734052.512012:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787734052.512014:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734052.512016:0:14477:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787734052.512018:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787734052.512476:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734052.512479:0:14477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787734052.512567:0:14477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891efe936000 00000020:00000080:2.0:1787734052.512571:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787734052.512671:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787734052.512674:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734052.512676:0:14477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787734052.512678:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787734052.512681:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734052.512682:0:14477:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787734052.512685:0:14477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff891efe936000 00000020:00000080:2.0:1787734052.512687:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787734052.515641:0:14477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14477:1874574705773440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787734052.515732:0:14477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734052.515838:0:14477:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec596d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787734052.525164:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705773440 00000100:00100000:1.0:1787734052.525182:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705773440 00000100:00100000:1.0:1787734052.525389:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787734052.525400:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14477:x1874574705773440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787734052.525691:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14477:x1874574705773440:12345-0@lo:502:llog_process_th.0 Request processed in 292us (9959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734052.525700:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787734052.529596:0:14477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14477:1874574705773440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787734052.529643:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787734052.529654:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787734052.529663:0:14477:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787734052.529670:0:14477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787734052.529887:0:14433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787734052.529918:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787734052.529935:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.529947:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734052.529996:0:14433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787734052.529999:0:14433:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff891efe936000 10000000:01000000:0.0:1787734052.530002:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff891efe936000 10000000:01000000:0.0:1787734052.530005:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787734052.530016:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891efe936000 from 1 10000000:01000000:0.0:1787734052.530019:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787734052.530051:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659600/0x45228d86de4d6673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.530058:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6659600/0x45228d86de4d6673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.530067:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6659600/0x45228d86de4d6673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734052.530086:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705773568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787734052.530152:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734052.530774:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37300 going to sleep for 11 seconds 00000100:00100000:2.0:1787734052.534675:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705773568 00000100:00100000:2.0:1787734052.534696:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705773568 00000100:00100000:2.0:1787734052.534751:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787734052.534762:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14433:x1874574705773568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787734052.534780:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734052.534799:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ef6b60600/0x45228d86de4d667a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d6673 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.534831:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ef6b60600/0x45228d86de4d667a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d6673 expref: 12 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.534844:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ef6b60600/0x45228d86de4d667a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d6673 expref: 12 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.534854:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ef6b60600, rc 0) 00000100:00100000:2.0:1787734052.534939:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14433:x1874574705773568:12345-0@lo:101:mount.lustre.0 Request processed in 179us (4787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734052.534947:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787734052.536743:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705773568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787734052.536768:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6659600/0x45228d86de4d6673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d667a expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.536781:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6659600/0x45228d86de4d6673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d667a expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734052.536853:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705773696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787734052.536899:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734052.536935:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37300 going to sleep for 11 seconds 00000100:00100000:2.0:1787734052.537360:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705773696 00000100:00100000:2.0:1787734052.537375:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705773696 00000100:00100000:2.0:1787734052.537423:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787734052.537432:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14433:x1874574705773696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787734052.537857:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14433:x1874574705773696:12345-0@lo:501:mount.lustre.0 Request processed in 425us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734052.537865:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787734052.539585:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705773696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787734052.539645:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705773824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787734052.539704:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734052.539752:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37300 going to sleep for 11 seconds 00000100:00100000:2.0:1787734052.540452:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705773824 00000100:00100000:2.0:1787734052.540459:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705773824 00000100:00100000:2.0:1787734052.540584:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787734052.540595:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14433:x1874574705773824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787734052.540797:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14433:x1874574705773824:12345-0@lo:503:mount.lustre.0 Request processed in 203us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734052.540805:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787734052.541589:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705773824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787734052.543689:0:14481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14481:1874574705773952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787734052.543770:0:14481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734052.543814:0:14481:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b0ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787734052.544592:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705773952 00000100:00100000:3.0:1787734052.544611:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705773952 00000100:00100000:3.0:1787734052.544671:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787734052.544681:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14481:x1874574705773952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787734052.544953:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14481:x1874574705773952:12345-0@lo:502:llog_process_th.0 Request processed in 274us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734052.544962:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787734052.545635:0:14481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14481:1874574705773952:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787734052.545703:0:14481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787734052.545717:0:14481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff891ee57bcd28) 00000020:00000080:2.0:1787734052.545737:0:14481:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787734052.545814:0:14481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891efe936000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787734052.545819:0:14481:0:(tgt_mount.c:187:server_put_mount()) put mount ffff891efe936000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787734052.545821:0:14481:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891efe936000 4 00010000:00080000:2.0:1787734052.545849:0:14481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891ec3387800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1787734052.552928:0:14481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787734052.553117:0:14481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787734052.553151:0:14481:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787734052.553188:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x45228d86de4d6688 00000100:00080000:2.0:1787734052.553200:0:14481:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787734052.553207:0:14481:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff891ec3387800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787734052.553276:0:14481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891efef6a300 x1874574705774080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787734052.553315:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874574705774080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787734052.556566:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734052.556682:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705774080 00000100:00100000:2.0:1787734052.556691:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705774080 00000100:00100000:2.0:1787734052.556728:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787734052.556735:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874574705774080:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787734052.556797:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874574705774080:12345-0@lo:38:llog_process_th.0 Request processed in 61us (238us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787734052.556803:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787734052.556850:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787734052.556858:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ec3387800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787734052.556869:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787734052.556874:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874574705774080:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787734052.556903:0:14481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787734052.564928:0:14481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14481:1874574705774208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787734052.565008:0:14481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734052.565053:0:14481:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b0e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787734052.565195:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705774208 00000100:00100000:3.0:1787734052.565203:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705774208 00000100:00100000:3.0:1787734052.565270:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787734052.565280:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14481:x1874574705774208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787734052.565706:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14481:x1874574705774208:12345-0@lo:502:llog_process_th.0 Request processed in 427us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734052.565715:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787734052.568192:0:14481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14481:1874574705774208:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787734052.568260:0:14481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787734052.573229:0:14433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787734052.573274:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787734052.573297:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659600/0x45228d86de4d6673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d667a expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734052.573311:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6659600/0x45228d86de4d6673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d667a expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787734052.573375:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787734052.573378:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787734052.573379:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787734052.573380:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787734052.573382:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787734052.573383:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787734052.573384:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787734052.573386:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787734052.573388:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787734052.573389:0:14433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787734052.573393:0:14433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787734052.573396:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787734052.573397:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787734052.573398:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787734052.573399:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787734052.573400:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787734052.573401:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787734052.573402:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787734052.573403:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787734052.573404:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787734052.573405:0:14433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787734052.573432:0:14433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787734052.573454:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705774336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787734052.573553:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734052.573595:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d37a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787734052.582299:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705774336 00000100:00100000:3.0:1787734052.582314:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705774336 00000100:00100000:3.0:1787734052.582375:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787734052.582386:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14433:x1874574705774336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787734052.582417:0:14444:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787734052.582430:0:14444:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787734052.638732:0:14444:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787734052.638752:0:14444:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787734052.645069:0:14467:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787734052.645079:0:14467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787734052.645104:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.645127:0:14467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec60cdc00/0x45228d86de4d665e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d6657 expref: 12 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.645135:0:14467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.645197:0:14467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec60cdc00/0x45228d86de4d665e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d6657 expref: 12 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.645230:0:14467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec60cdc00/0x45228d86de4d665e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d6657 expref: 12 pid: 14445 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734052.645260:0:14467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1874574705774464:0@lo:104: 00000100:00100000:2.0:1787734052.645325:0:14467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734052.645371:0:14467:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b0ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787734052.645555:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705774464 00000100:00100000:3.0:1787734052.645563:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705774464 00000100:00100000:3.0:1787734052.645620:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787734052.645630:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:14467:x1874574705774464:12345-0@lo:104: 00010000:00010000:3.0:1787734052.645651:0:14434:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.645713:0:14434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787734052.645719:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:14467:x1874574705774464:12345-0@lo:104: Request processed in 91us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734052.645726:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787734052.645751:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734052.645757:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.645765:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658c00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787734052.645770:0:14440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.645778:0:14440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787734052.645785:0:14440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734052.645791:0:14440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787734052.645821:0:14440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.645828:0:14440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787734052.645849:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.645856:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d6657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d665e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.645880:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734052.645882:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734052.645883:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787734052.645913:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3310:1874574705774592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787734052.645950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734052.646019:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705774592 00000100:00100000:3.0:1787734052.646024:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705774592 00010000:00010000:3.0:1787734052.646056:0:14436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec60cdc00/0x45228d86de4d665e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d6657 expref: 13 pid: 14445 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734052.646078:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787734052.646086:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+13:3310:x1874574705774592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787734052.646096:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734052.646101:0:14436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec60cdc00/0x45228d86de4d665e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d6657 expref: 13 pid: 14445 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.646112:0:14436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec60cdc00/0x45228d86de4d665e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d6657 expref: 13 pid: 14445 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.646129:0:14436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.646138:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787734052.646151:0:14436:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001073361s 00010000:00010000:3.0:1787734052.646190:0:14436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.646208:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.646215:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.646222:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.646228:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b60e00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734052.646242:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.646250:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.646260:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734052.646272:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734052.646302:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+13:3310:x1874574705774592:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734052.646309:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787734052.646345:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3310:1874574705774592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787734052.646950:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec60cdc00/0x45228d86de4d665e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d6657 expref: 12 pid: 14445 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734052.646966:0:14467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1874574705774464:0@lo:104: 00010000:00010000:2.0:1787734052.646980:0:14467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.646989:0:14467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.646995:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734052.647000:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ef6b60e00/0x45228d86de4d668f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734052.647804:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14433:x1874574705774336:12345-0@lo:253:mount.lustre.0 Request processed in 65416us (74247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734052.647815:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787734052.647899:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14433:1874574705774336:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787734052.647912:0:14433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787734052.647916:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787734052.647918:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787734052.647919:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787734052.647920:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787734052.647921:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787734052.647922:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787734052.647923:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787734052.647925:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787734052.647926:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787734052.647936:0:14433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787734052.647952:0:14433:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787734052.656523:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787734052.656674:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787734052.657367:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787734052.657554:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787734052.657840:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787734052.663065:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787734052.664441:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787734052.664609:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787734052.664865:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787734052.665076:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787734052.665371:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787734052.665531:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787734052.726681:0:14433:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787734052.727368:0:14433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787734052.727915:0:14490:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787734052.728014:0:14490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787734052.730051:0:14490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787734052.730139:0:14490:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787734052.730144:0:14490:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1787734052.732907:0:14433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787734052.733051:0:14433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787734052.733476:0:14433:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787734052.733485:0:14433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787734052.733606:0:14433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1787734052.738735:0:14489:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787734052.738745:0:14489:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1787734052.741619:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787734052.744563:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787734052.744629:0:14433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787734052.745773:0:14433:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1787734052.750921:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787734052.762287:0:14433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787734052.797339:0:14433:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787734052.797379:0:14433:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb062c1c67988 00100000:10000000:0.0:1787734052.797389:0:14433:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787734052.799719:0:14433:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787734052.799737:0:14433:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787734052.799750:0:14433:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787734052.799769:0:14433:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787734053.114615:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787734053.628323:0:14485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787734053.628333:0:14485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787734053.628759:0:14485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787734053.628767:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1787734054.075779:0:14448:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787734054.075788:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff891efe936000 from 6 10000000:01000000:0.0:1787734054.075794:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787734054.075839:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734054.075861:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734054.075872:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734054.075895:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705774720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787734054.075957:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734054.076010:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef83f1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787734054.076262:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705774720 00000100:00100000:3.0:1787734054.076269:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705774720 00000100:00100000:3.0:1787734054.076321:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787734054.076331:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14448:x1874574705774720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787734054.076344:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734054.076361:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891f020c1a00/0x45228d86de4d669d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d6696 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734054.076382:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020c1a00/0x45228d86de4d669d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d6696 expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734054.076393:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891f020c1a00/0x45228d86de4d669d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d6696 expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734054.076403:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c1a00, rc 0) 00000100:00100000:3.0:1787734054.076445:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14448:x1874574705774720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734054.076452:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787734054.076770:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705774720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787734054.076786:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734054.076795:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734054.076848:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705774848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787734054.076880:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734054.076910:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef83f1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787734054.077048:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705774848 00000100:00100000:3.0:1787734054.077053:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705774848 00000100:00100000:3.0:1787734054.077087:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787734054.077101:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14448:x1874574705774848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787734054.077115:0:14444:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787734054.077131:0:14444:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787734054.077134:0:14444:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787734054.077276:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14448:x1874574705774848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734054.077283:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787734054.077417:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705774848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787734054.077461:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787734054.077470:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734054.077478:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734054.140101:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787734054.664984:0:14485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787734054.664994:0:14485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787734054.665659:0:14485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787734054.665778:0:14485:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787734054.665816:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1787734055.163565:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734056.186533:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787734056.958344:0:14733:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787734057.210509:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787734057.789237:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787734057.789243:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787734057.789245:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787734057.789248:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787734057.789250:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787734057.789265:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787734057.789268:0:8:0:(import.c:65:import_set_state_nolock()) ffff891ec3387800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787734057.789280:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff891ec3387800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787734057.789306:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891efef6b480 x1874574705775104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787734057.789402:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874574705775104:0@lo:38:kworker.0 00000100:00100000:3.0:1787734057.789467:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734057.789537:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3311:1874574705774976:0@lo:400:kworker.0 00000100:00100000:3.0:1787734057.789575:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734057.789640:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705774976 00000100:00100000:3.0:1787734057.789647:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705774976 00000100:00100000:3.0:1787734057.789694:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787734057.789706:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:3311:x1874574705774976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787734057.789756:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:3311:x1874574705774976:12345-0@lo:400:kworker.0 Request processed in 53us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734057.789763:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787734057.789814:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3311:1874574705774976:0@lo:400:kworker.0 00000100:00100000:2.0:1787734057.790408:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705775104 00000100:00100000:2.0:1787734057.790412:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705775104 00000100:00100000:2.0:1787734057.790431:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787734057.790435:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874574705775104:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787734057.790454:0:14453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:2.0:1787734057.790481:0:14453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x45228d86de4d66a4 00000004:00100000:2.0:1787734057.790493:0:14453:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787734057.790626:0:14453:0:(import.c:65:import_set_state_nolock()) ffff891ec3382000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787734057.790662:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874574705775104:12345-0@lo:38:kworker.0 Request processed in 226us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734057.790668:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787734057.791900:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff891efef6b480 x1874574705775104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787734067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787734057.791933:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787734057.791942:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787734057.791948:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787734057.791951:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ec3387800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787734057.791958:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874574705775104:0@lo:38:kworker.0 00010000:00010000:0.0:1787734058.235652:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787734059.254677:0:14884:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca981cc30 20000000:00000080:0.0:1787734059.254841:0:14884:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff891eee83f000 uarg=0000000000000000 20000000:01000000:0.0:1787734059.254875:0:14884:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787734059.254882:0:14884:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787734059.254886:0:14884:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787734059.255785:0:14885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787734059.256059:0:14884:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 00010000:00010000:1.0:1787734059.258365:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787734059.264335:0:14884:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787734059.264682:0:14884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734059.264705:0:14884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ef6b61e00/0x45228d86de4d666c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d6665 expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734059.264713:0:14884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734059.264756:0:14884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ef6b61e00/0x45228d86de4d666c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d6665 expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734059.264771:0:14884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ef6b61e00/0x45228d86de4d666c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d6665 expref: 11 pid: 14446 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734059.264787:0:14884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14884:1874574705775232:0@lo:104: 00000100:00100000:1.0:1787734059.264852:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734059.264954:0:14884:0:(client.c:2715:ptlrpc_set_wait()) set ffff891eed1a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787734059.265859:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705775232 00000100:00100000:3.0:1787734059.265869:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705775232 00000100:00100000:3.0:1787734059.266022:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787734059.266034:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:14884:x1874574705775232:12345-0@lo:104: 00010000:00010000:3.0:1787734059.266049:0:14435:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.266147:0:14435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787734059.266172:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:14884:x1874574705775232:12345-0@lo:104: Request processed in 123us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734059.266180:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787734059.266272:0:14884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14884:1874574705775232:0@lo:104: 00010000:00010000:2.0:1787734059.266292:0:14884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734059.266438:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734059.266445:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734059.266454:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658600 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787734059.266459:0:14440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734059.266468:0:14440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787734059.266476:0:14440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734059.266482:0:14440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787734059.266513:0:14440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734059.266520:0:14440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787734059.266540:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734059.266547:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec6658600/0x45228d86de4d6665 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d666c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734059.266565:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734059.266567:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734059.266568:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787734059.266593:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705775360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787734059.266630:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734059.266877:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705775360 00000100:00100000:3.0:1787734059.266882:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705775360 00010000:00010000:3.0:1787734059.266900:0:14436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ef6b61e00/0x45228d86de4d666c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d6665 expref: 12 pid: 14446 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734059.267093:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787734059.267101:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:3312:x1874574705775360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787734059.267113:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734059.267129:0:14436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ef6b61e00/0x45228d86de4d666c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d6665 expref: 12 pid: 14446 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.267148:0:14436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ef6b61e00/0x45228d86de4d666c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d6665 expref: 12 pid: 14446 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.267186:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ef6b61e00/0x45228d86de4d666c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d6665 expref: 12 pid: 14446 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.267201:0:14436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.267209:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.267225:0:14436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.267233:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.267241:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.267248:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.267254:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734059.267258:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.267266:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734059.267576:0:14884:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734059.267586:0:14884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.268846:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.268863:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec60cc400/0x45228d86de4d66ab lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734059.268886:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734059.269223:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:3312:x1874574705775360:12345-0@lo:103:ldlm_bl.0 Request processed in 2120us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734059.269234:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787734059.270391:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705775360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787734060.282354:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787734060.730288:0:14448:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787734060.730297:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891efe936000 from 10 10000000:01000000:2.0:1787734060.730303:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787734060.730356:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734060.730368:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734060.730379:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734060.730405:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705775488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787734060.730476:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734060.730551:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86180 going to sleep for 11 seconds 00000100:00100000:0.0:1787734060.733190:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705775488 00000100:00100000:0.0:1787734060.733205:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705775488 00000100:00100000:0.0:1787734060.733272:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787734060.733283:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+11:14448:x1874574705775488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787734060.733299:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734060.733324:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6658e00/0x45228d86de4d66b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d66b2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734060.733351:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6658e00/0x45228d86de4d66b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d66b2 expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734060.733361:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6658e00/0x45228d86de4d66b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d66b2 expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734060.733370:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658e00, rc 0) 00000100:00100000:0.0:1787734060.733452:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14448:x1874574705775488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734060.733459:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787734060.733606:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705775488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787734060.733624:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734060.733633:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734060.733699:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705775616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787734060.733731:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734060.733771:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86180 going to sleep for 11 seconds 00000100:00100000:3.0:1787734060.733830:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705775616 00000100:00100000:3.0:1787734060.733835:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705775616 00000100:00100000:3.0:1787734060.733860:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787734060.733867:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14448:x1874574705775616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787734060.734127:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14448:x1874574705775616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734060.734135:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787734060.734249:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705775616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787734060.734276:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705775744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787734060.734321:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734060.734347:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86180 going to sleep for 11 seconds 00000100:00100000:0.0:1787734060.734402:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705775744 00000100:00100000:0.0:1787734060.734406:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705775744 00000100:00100000:0.0:1787734060.734424:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787734060.734430:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14448:x1874574705775744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787734060.734574:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:14448:x1874574705775744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734060.734581:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787734060.734772:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705775744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787734060.742319:0:14946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787734060.742640:0:14448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787734060.742661:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787734060.742672:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734060.742683:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734061.308962:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734062.336681:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787734062.910200:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787734062.910221:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787734062.910224:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787734062.910227:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787734062.910290:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787734062.910299:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787734052/real 1787734052] req@ffff891ec60c9880 x1874574705772416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787734062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787734062.910312:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705775872:0@lo:400:kworker.0 00000100:00100000:0.0:1787734062.910328:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff891ec60c9880 x1874574705772416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787734062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787734062.910339:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787734052/real 1787734052] req@ffff891ec60c9c00 x1874574705772288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787734062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787734062.910350:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff891ec60c9c00 x1874574705772288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787734062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787734062.910363:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ec6320800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787734062.910376:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787734062.910383:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705772416:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787734062.910385:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787734062.910394:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891efee5c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787734062.910402:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787734062.910406:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705772288:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787734062.910445:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705775872 00000100:00100000:0.0:1787734062.910452:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705775872 00000100:00080000:1.0:1787734062.910491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787734062.910496:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:0.0:1787734062.910498:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787734062.910500:0:8:0:(import.c:65:import_set_state_nolock()) ffff891efee5c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787734062.910508:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 370 00000100:00080000:1.0:1787734062.910514:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1787734062.910522:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:3312:x1874574705775872:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787734062.910523:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff891efee5c800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787734062.910552:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891eeff2c700 x1874574705776128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787734062.910581:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:3312:x1874574705775872:12345-0@lo:400:kworker.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00080000:1.0:1787734062.910585:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787734062.910589:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787734062.910591:0:8:0:(import.c:65:import_set_state_nolock()) ffff891ec6320800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787734062.910599:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 370 00000100:00080000:1.0:1787734062.910603:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1787734062.910605:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787734062.910610:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff891ec6320800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787734062.910626:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891eeff2ce00 x1874574705776256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787734062.910659:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705776128:0@lo:8:kworker.0 00000400:00000100:1.0:1787734062.910682:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874574705776128 offset 0 length 520: 4 00000100:00100000:1.0:1787734062.910699:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705776256:0@lo:8:kworker.0 00000400:00000100:1.0:1787734062.910715:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874574705776256 offset 0 length 520: 4 00000100:00100000:0.0:1787734062.910766:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705775872:0@lo:400:kworker.0 00000100:00100000:3.0:1787734062.912123:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705776000:0@lo:400:kworker.0 00000100:00100000:3.0:1787734062.912218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734062.915151:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705776000 00000100:00100000:0.0:1787734062.915209:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705776000 00000100:00100000:0.0:1787734062.915268:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787734062.915279:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705776000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787734062.915375:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705776000:12345-0@lo:400:kworker.0 Request processed in 99us (3157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734062.915383:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787734062.916085:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff891ec60c9500 x1874574705776000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787734062.916102:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705776000:0@lo:400:kworker.0 00010000:00010000:0.0:1787734063.354319:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787734063.946363:0:15134:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787734063.946368:0:15134:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787734063.946512:0:15134:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff891efe4ce800 00000020:01000004:1.0:1787734063.946528:0:15134:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787734063.946539:0:15134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787734063.946554:0:15134:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff891ef6c6cd28) 00000020:00000080:1.0:1787734063.946569:0:15134:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787734063.962933:0:15134:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787734063.963331:0:15134:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787734063.964234:0:15134:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787734063.964525:0:15134:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787734063.964746:0:15134:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787734063.965133:0:15134:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 565: rc = 0 00100000:10000000:0.0:1787734063.965574:0:15134:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 565: rc = 0 00100000:10000000:0.0:1787734063.965677:0:15134:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 565: rc = 0 00100000:10000000:0.0:1787734063.966299:0:15134:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 773: rc = 0 00100000:10000000:0.0:1787734063.966642:0:15134:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 773: rc = 0 00100000:10000000:0.0:1787734063.966969:0:15134:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:0.0:1787734063.967342:0:15134:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:0.0:1787734063.967682:0:15134:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:0.0:1787734063.968018:0:15134:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 773: rc = 0 00000020:00000080:0.0:1787734063.968740:0:15134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787734063.968751:0:15134:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787734063.968834:0:15134:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x45228d86de4d66c7 00000020:01000004:0.0:1787734063.968844:0:15134:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787734063.968865:0:15134:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787734063.968868:0:15134:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787734063.968874:0:15134:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787734063.968878:0:15134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787734063.968895:0:15134:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff891eeea70000) 00000020:00000080:0.0:1787734063.968909:0:15134:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787734063.970387:0:15134:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787734063.970712:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787734063.970722:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787734063.971423:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787734063.971431:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787734063.971698:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787734063.971705:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787734063.973277:0:15134:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787734063.973443:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787734063.973524:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787734063.974793:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787734063.974802:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787734063.992374:0:15134:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787734063.992584:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787734063.992590:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787734063.993653:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787734063.993661:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787734063.994359:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787734063.994364:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787734063.995984:0:15134:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787734063.996568:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787734063.996575:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787734063.997052:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787734063.997058:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787734064.029003:0:15134:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787734064.029239:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787734064.029248:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787734064.032661:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787734064.032676:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787734064.033122:0:15134:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787734064.033148:0:15134:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787734064.033322:0:15134:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787734064.043022:0:15134:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787734064.043071:0:15134:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787734064.043076:0:15134:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787734064.043078:0:15134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787734064.043079:0:15134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787734064.043081:0:15134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787734064.043082:0:15134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787734064.043084:0:15134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787734064.043085:0:15134:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787734064.043087:0:15134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787734064.043088:0:15134:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787734064.043092:0:15134:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787734064.043099:0:15134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787734064.043101:0:15134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787734064.043102:0:15134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787734064.043103:0:15134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787734064.043104:0:15134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787734064.043105:0:15134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787734064.043105:0:15134:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787734064.043106:0:15134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787734064.043107:0:15134:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787734064.043132:0:15134:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787734064.043425:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705776384:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787734064.043584:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734064.043762:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e23600 going to sleep for 11 seconds 00000100:00100000:3.0:1787734064.043808:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705776384 00000100:00100000:3.0:1787734064.043817:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705776384 00000100:00100000:3.0:1787734064.043873:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787734064.043882:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:15134:x1874574705776384:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787734064.043914:0:14445:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787734064.043917:0:14445:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787734064.043927:0:14445:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787734064.057677:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:15134:x1874574705776384:12345-0@lo:253:mount.lustre.0 Request processed in 13785us (14083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734064.057692:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787734064.057800:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705776384:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787734064.057819:0:15134:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787734064.057823:0:15134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787734064.057825:0:15134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787734064.057826:0:15134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787734064.057827:0:15134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787734064.057829:0:15134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787734064.057830:0:15134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787734064.057831:0:15134:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787734064.057834:0:15134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787734064.057835:0:15134:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787734064.057854:0:15134:0:(tgt_mount.c:101:server_register_mount()) register mount ffff891efe4ce800 from lustre-OST0000 10000000:01000000:1.0:1787734064.057883:0:15134:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787734064.057885:0:15134:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787734064.057892:0:15134:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff891ef6c6b370 local copy 00010000:00010000:1.0:1787734064.057902:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65c4 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734064.058151:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705776512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787734064.058225:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734064.058273:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e23180 going to sleep for 11 seconds 00000100:00100000:2.0:1787734064.058383:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705776512 00000100:00100000:2.0:1787734064.058390:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705776512 00000100:00100000:2.0:1787734064.058436:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787734064.058455:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:15134:x1874574705776512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787734064.058619:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:15134:x1874574705776512:12345-0@lo:501:mount.lustre.0 Request processed in 174us (393us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787734064.058626:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787734064.060747:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705776512:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787734064.060776:0:15134:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787734064.061069:0:15134:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787734064.061079:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65c4 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.061090:0:15134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65c4 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734064.061120:0:15134:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff891efe4ce800 10000000:01000000:3.0:1787734064.061126:0:15134:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787734064.061131:0:15134:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff891ef6c6b370 10000000:01000000:3.0:1787734064.061134:0:15134:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787734064.061137:0:15134:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff891ef6c6b370 from 1 10000000:01000000:3.0:1787734064.061141:0:15134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787734064.061219:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d66d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.061228:0:15134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d66d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.061239:0:15134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d66d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734064.061260:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705776640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787734064.061328:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.061377:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b0ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787734064.061606:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705776640 00000100:00100000:1.0:1787734064.061613:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705776640 00000100:00100000:1.0:1787734064.061664:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787734064.061674:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+12:15134:x1874574705776640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787734064.061686:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787734064.061701:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cce00/0x45228d86de4d66dc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d66d5 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.061723:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cce00/0x45228d86de4d66dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d66d5 expref: 13 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.061734:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cce00/0x45228d86de4d66dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d66d5 expref: 13 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.061743:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cce00, rc 0) 00000100:00100000:1.0:1787734064.061795:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+13:15134:x1874574705776640:12345-0@lo:101:mount.lustre.0 Request processed in 123us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734064.061802:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787734064.062563:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705776640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787734064.062580:0:15134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d66d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d66dc expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.062589:0:15134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d66d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d66dc expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734064.062609:0:15134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787734064.062625:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d66d5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d66dc expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.062632:0:15134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c1c00/0x45228d86de4d66d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d66dc expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734064.062640:0:15134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787734064.062645:0:15134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787734064.062650:0:15134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787734064.062653:0:15134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787734064.062671:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d66e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.062678:0:15134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d66e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.062686:0:15134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d66e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734064.062701:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705776768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787734064.062746:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.062780:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b0ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787734064.062834:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705776768 00000100:00100000:1.0:1787734064.062839:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705776768 00000100:00100000:1.0:1787734064.062875:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787734064.062883:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+13:15134:x1874574705776768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787734064.062893:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787734064.062903:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cda00/0x45228d86de4d66ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d66e3 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.062919:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cda00/0x45228d86de4d66ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d66e3 expref: 14 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.062928:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cda00/0x45228d86de4d66ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d66e3 expref: 14 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.062942:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cda00, rc 0) 00000100:00100000:1.0:1787734064.062997:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+14:15134:x1874574705776768:12345-0@lo:101:mount.lustre.0 Request processed in 115us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734064.063004:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787734064.063220:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705776768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787734064.063232:0:15134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d66e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d66ea expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.063240:0:15134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d66e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d66ea expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787734064.064775:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787734064.067054:0:15134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787734064.067363:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787734064.067408:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787734064.067438:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787734064.067593:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787734064.067628:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787734064.067665:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787734064.067729:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787734064.067737:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787734064.067826:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705776896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734064.067886:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.067933:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b0e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787734064.068719:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705776896 00000100:00100000:2.0:1787734064.068728:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705776896 00000100:00100000:2.0:1787734064.068785:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787734064.068795:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+14:15134:x1874574705776896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787734064.069232:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+14:15134:x1874574705776896:12345-0@lo:501:mount.lustre.0 Request processed in 437us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734064.069240:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787734064.069688:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705776896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734064.069732:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787734064.069785:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.069815:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b0e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787734064.069903:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705777024 00000100:00100000:1.0:1787734064.069909:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705777024 00000100:00100000:1.0:1787734064.069948:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787734064.069957:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+14:15134:x1874574705777024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787734064.070355:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+14:15134:x1874574705777024:12345-0@lo:503:mount.lustre.0 Request processed in 399us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734064.070365:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787734064.070396:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777024:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787734064.070939:0:15134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787734064.071013:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787734064.071066:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734064.071243:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891eed1a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787734064.071419:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705777152 00000100:00100000:0.0:1787734064.071426:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705777152 00000100:00100000:0.0:1787734064.071461:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787734064.071471:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+14:15134:x1874574705777152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787734064.071739:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+14:15134:x1874574705777152:12345-0@lo:502:mount.lustre.0 Request processed in 270us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734064.071746:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787734064.071814:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787734064.072241:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787734064.072292:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787734064.072322:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787734064.072368:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787734064.072405:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787734064.072437:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787734064.072485:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787734064.072521:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787734064.072555:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787734064.072601:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787734064.072637:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787734064.072684:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787734064.072718:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787734064.072771:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734064.072864:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891eed1a10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787734064.073018:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705777280 00000100:00100000:3.0:1787734064.073024:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705777280 00000100:00100000:3.0:1787734064.074454:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787734064.074465:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+14:15134:x1874574705777280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787734064.074713:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+14:15134:x1874574705777280:12345-0@lo:502:mount.lustre.0 Request processed in 250us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734064.074721:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787734064.074949:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787734064.075078:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787734064.075092:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787734064.081822:0:15148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787734064.081836:0:15148:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787734064.081843:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787734064.081845:0:15148:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787734064.081853:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787734064.081870:0:15148:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff891ef6c699b8) 00000020:00000080:1.0:1787734064.081893:0:15148:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787734064.081899:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787734064.081985:0:15148:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891efe4ce800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787734064.081994:0:15148:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787734064.082002:0:15148:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x45228d86de4d66f8 00010000:00010000:0.0:1787734064.089745:0:15148:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787734064.091645:0:15148:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787734064.095785:0:15148:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787734064.101579:0:15148:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787734064.101591:0:15148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787734064.101597:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787734064.101599:0:15148:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787734064.101603:0:15148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787734064.101611:0:15148:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787734064.101613:0:15148:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787734064.101614:0:15148:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787734064.101616:0:15148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787734064.101618:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787734064.101620:0:15148:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787734064.101622:0:15148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787734064.101625:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787734064.101626:0:15148:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787734064.101630:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787734064.101632:0:15148:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787734064.101634:0:15148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787734064.101636:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787734064.101637:0:15148:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787734064.101640:0:15148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787734064.101642:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787734064.101643:0:15148:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787734064.101646:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787734064.101706:0:15148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787734064.101709:0:15148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787734064.101711:0:15148:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787734064.101714:0:15148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787734064.101874:0:15134:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787734064.101903:0:15134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787734064.101924:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d66e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d66ea expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.101937:0:15134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c1400/0x45228d86de4d66e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d66ea expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734064.101946:0:15134:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891efe4ce800 from 1 10000000:01000000:3.0:1787734064.101948:0:15134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787734064.101982:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.101990:0:15134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.102001:0:15134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734064.102025:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787734064.102104:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.102148:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec8063d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787734064.104301:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705777408 00000100:00100000:0.0:1787734064.104318:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705777408 00000100:00100000:0.0:1787734064.104378:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787734064.104389:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+14:15134:x1874574705777408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787734064.104407:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734064.104435:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6659c00/0x45228d86de4d6706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d66ff expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734064.104463:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6659c00/0x45228d86de4d6706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d66ff expref: 15 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734064.104475:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6659c00/0x45228d86de4d6706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d66ff expref: 15 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734064.104485:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659c00, rc 0) 00000100:00100000:0.0:1787734064.104554:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705777408:12345-0@lo:101:mount.lustre.0 Request processed in 167us (2450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734064.104562:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787734064.104776:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787734064.104796:0:15134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.104813:0:15134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787734064.105570:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787734064.105950:0:15134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787734064.108689:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787734064.108772:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787734064.108843:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787734064.108851:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787734064.108953:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734064.109021:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.109082:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec8063d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787734064.109297:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705777536 00000100:00100000:0.0:1787734064.109304:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705777536 00000100:00100000:0.0:1787734064.109347:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787734064.109355:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705777536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787734064.109578:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705777536:12345-0@lo:501:mount.lustre.0 Request processed in 222us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734064.109586:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787734064.109727:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734064.109761:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787734064.109802:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.109914:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec8063d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787734064.115334:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705777664 00000100:00100000:0.0:1787734064.115350:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705777664 00000100:00100000:0.0:1787734064.115402:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787734064.115410:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705777664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787734064.115626:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705777664:12345-0@lo:503:mount.lustre.0 Request processed in 216us (5823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734064.115634:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787734064.115774:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777664:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787734064.116294:0:15134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787734064.116365:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787734064.116417:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.116447:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86900 going to sleep for 11 seconds 00000100:00100000:0.0:1787734064.117275:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705777792 00000100:00100000:0.0:1787734064.117290:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705777792 00000100:00100000:0.0:1787734064.117324:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787734064.117333:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705777792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787734064.117531:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705777792:12345-0@lo:502:mount.lustre.0 Request processed in 199us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734064.117539:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787734064.117795:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787734064.118081:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787734064.118133:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787734064.118883:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787734064.118937:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787734064.118972:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787734064.119031:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787734064.119084:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787734064.119115:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787734064.119970:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787734064.120060:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.120190:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86900 going to sleep for 11 seconds 00000100:00100000:0.0:1787734064.122826:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705777920 00000100:00100000:0.0:1787734064.122844:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705777920 00000100:00100000:0.0:1787734064.122947:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787734064.122959:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705777920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787734064.123283:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705777920:12345-0@lo:502:mount.lustre.0 Request processed in 325us (3222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734064.123290:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787734064.123397:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705777920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787734064.123560:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787734064.123575:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787734064.126596:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787734064.126611:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734064.126614:0:15152:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787734064.126621:0:15152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891efe4ce800 00000020:00000080:0.0:1787734064.126623:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787734064.126631:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787734064.126634:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734064.126635:0:15152:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787734064.126637:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787734064.126640:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734064.126641:0:15152:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787734064.126644:0:15152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891efe4ce800 00000020:00000080:0.0:1787734064.126645:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787734064.127797:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787734064.127810:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734064.127812:0:15152:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787734064.127815:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787734064.127831:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734064.127832:0:15152:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787734064.127836:0:15152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff891efe4ce800 00000020:00000080:0.0:1787734064.127838:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787734064.127911:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787734064.127916:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787734064.127917:0:15152:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787734064.127920:0:15152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787734064.132843:0:15134:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787734064.132887:0:15134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787734064.132910:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.132924:0:15134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787734064.132984:0:15134:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787734064.132987:0:15134:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff891efe4ce800 10000000:01000000:1.0:1787734064.132990:0:15134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff891efe4ce800 10000000:01000000:1.0:1787734064.132994:0:15134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787734064.133005:0:15134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891efe4ce800 from 1 10000000:01000000:1.0:1787734064.133007:0:15134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787734064.133072:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cd600/0x45228d86de4d670d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.133081:0:15134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec60cd600/0x45228d86de4d670d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.133093:0:15134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec60cd600/0x45228d86de4d670d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734064.133116:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778048:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787734064.133219:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734064.133266:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e23300 going to sleep for 11 seconds 00000100:00100000:0.0:1787734064.135293:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705778048 00000100:00100000:0.0:1787734064.135307:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705778048 00000100:00100000:0.0:1787734064.135365:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787734064.135375:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705778048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787734064.135392:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734064.135409:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6658400/0x45228d86de4d6714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d670d expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734064.135435:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6658400/0x45228d86de4d6714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d670d expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734064.135446:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6658400/0x45228d86de4d6714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d670d expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734064.135455:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658400, rc 0) 00000100:00100000:0.0:1787734064.135523:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15134:x1874574705778048:12345-0@lo:101:mount.lustre.0 Request processed in 149us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734064.135530:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787734064.138802:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787734064.138829:0:15134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec60cd600/0x45228d86de4d670d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6714 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.138842:0:15134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec60cd600/0x45228d86de4d670d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d6714 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787734064.139530:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787734064.139816:0:15134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787734064.140076:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787734064.140117:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787734064.140145:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787734064.140223:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787734064.140257:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787734064.140299:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787734064.140330:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787734064.140370:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787734064.140415:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787734064.140466:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787734064.140521:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787734064.140576:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787734064.140612:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787734064.140647:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787734064.140695:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787734064.140731:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787734064.140765:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787734064.140813:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787734064.140849:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787734064.140883:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787734064.140932:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787734064.140967:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787734064.140996:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787734064.141062:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787734064.141099:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787734064.141146:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787734064.141222:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787734064.141254:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787734064.141326:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787734064.141333:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787734064.141425:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787734064.141494:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734064.145399:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8e23300 going to sleep for 11 seconds 00000100:00100000:2.0:1787734064.145862:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705778176 00000100:00100000:2.0:1787734064.145873:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705778176 00000100:00100000:2.0:1787734064.145929:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787734064.145939:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15134:x1874574705778176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787734064.149694:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15134:x1874574705778176:12345-0@lo:501:mount.lustre.0 Request processed in 3749us (8192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734064.149708:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787734064.150285:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734064.150336:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778304:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787734064.150380:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.150414:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86900 going to sleep for 11 seconds 00000100:00100000:1.0:1787734064.150861:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705778304 00000100:00100000:1.0:1787734064.150869:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705778304 00000100:00100000:1.0:1787734064.150909:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787734064.150918:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15134:x1874574705778304:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787734064.151115:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15134:x1874574705778304:12345-0@lo:503:mount.lustre.0 Request processed in 198us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734064.151128:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787734064.151840:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778304:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787734064.156660:0:15134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787734064.157935:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787734064.158018:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.158075:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86900 going to sleep for 11 seconds 00000100:00100000:0.0:1787734064.158882:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705778432 00000100:00100000:0.0:1787734064.158891:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705778432 00000100:00100000:0.0:1787734064.158940:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787734064.158949:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15134:x1874574705778432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787734064.159256:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15134:x1874574705778432:12345-0@lo:502:mount.lustre.0 Request processed in 307us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734064.159264:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787734064.159437:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787734064.159674:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787734064.159723:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787734064.159754:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787734064.159796:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787734064.159833:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787734064.159895:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787734064.159931:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787734064.159964:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787734064.160009:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787734064.161413:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787734064.161473:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787734064.161537:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787734064.161576:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787734064.161609:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787734064.161655:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787734064.162315:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787734064.162354:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787734064.162402:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787734064.163328:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787734064.163380:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787734064.163442:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787734064.163479:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787734064.163509:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787734064.163549:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787734064.163579:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787734064.163607:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787734064.163656:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787734064.164142:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787734064.164361:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787734064.164413:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787734064.164447:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787734064.164499:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787734064.164531:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787734064.164577:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787734064.164611:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787734064.164658:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787734064.165938:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787734064.165979:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787734064.166072:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787734064.166110:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787734064.166176:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787734064.166254:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.166302:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86900 going to sleep for 11 seconds 00000100:00100000:1.0:1787734064.169541:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705778560 00000100:00100000:1.0:1787734064.169557:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705778560 00000100:00100000:1.0:1787734064.169612:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787734064.169623:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15134:x1874574705778560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787734064.169929:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15134:x1874574705778560:12345-0@lo:502:mount.lustre.0 Request processed in 307us (3675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734064.169938:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787734064.174300:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787734064.174456:0:15134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787734064.174472:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787734064.184737:0:15157:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787734064.184766:0:15157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff891dc54bb370) 00000020:00000080:1.0:1787734064.184788:0:15157:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787734064.184863:0:15157:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891efe4ce800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787734064.184869:0:15157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff891efe4ce800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787734064.184872:0:15157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891efe4ce800 3 00010000:00080000:1.0:1787734064.184901:0:15157:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891dc5654800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1787734064.189899:0:15157:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787734064.190091:0:15157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787734064.190129:0:15157:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787734064.190142:0:15157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x45228d86de4d6722 00000100:00080000:1.0:1787734064.190152:0:15157:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787734064.190237:0:15157:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff891dc5654800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787734064.190286:0:15157:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891eeff2ca80 x1874574705778688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787734064.190331:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874574705778688:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787734064.190396:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734064.190478:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705778688 00000100:00100000:1.0:1787734064.190489:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705778688 00000100:00100000:1.0:1787734064.190520:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787734064.190528:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874574705778688:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787734064.190551:0:14451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:1.0:1787734064.190584:0:14451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x45228d86de4d6729 00000004:00100000:1.0:1787734064.190599:0:14451:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787734064.190626:0:14451:0:(import.c:65:import_set_state_nolock()) ffff891dc5652800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787734064.190678:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874574705778688:12345-0@lo:38:llog_process_th.0 Request processed in 148us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734064.190684:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787734064.190717:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff891eeff2ca80 x1874574705778688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787734074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787734064.190728:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787734064.190735:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787734064.190741:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787734064.190745:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787734064.190747:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891dc5654800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787734064.190752:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874574705778688:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787734064.190769:0:15157:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787734064.190792:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787734064.190797:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787734064.190800:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787734064.190803:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787734064.190847:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787734064.190862:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705778816:0@lo:400:kworker.0 00000100:00100000:1.0:1787734064.190888:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734064.190920:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705778816 00000100:00100000:1.0:1787734064.190924:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705778816 00000100:00100000:1.0:1787734064.190949:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787734064.190956:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705778816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734064.190993:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705778816:12345-0@lo:400:kworker.0 Request processed in 38us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734064.191000:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787734064.191024:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff891eeff2ca80 x1874574705778816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787734064.191811:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705778816:0@lo:400:kworker.0 00000040:00080000:2.0:1787734064.192287:0:15157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787734064.194098:0:15134:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787734064.194145:0:15134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787734064.194255:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cd600/0x45228d86de4d670d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6714 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734064.194269:0:15134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec60cd600/0x45228d86de4d670d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6714 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787734064.194321:0:15134:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787734064.194324:0:15134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787734064.194325:0:15134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787734064.194327:0:15134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787734064.194328:0:15134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787734064.194330:0:15134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787734064.194331:0:15134:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787734064.194333:0:15134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787734064.194334:0:15134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787734064.194338:0:15134:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787734064.194341:0:15134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787734064.194342:0:15134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787734064.194343:0:15134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787734064.194344:0:15134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787734064.194345:0:15134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787734064.194347:0:15134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787734064.194348:0:15134:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787734064.194349:0:15134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787734064.194350:0:15134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787734064.194382:0:15134:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787734064.194403:0:15134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778944:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787734064.194771:0:15134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734064.194821:0:15134:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d5d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787734064.194976:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705778944 00000100:00100000:2.0:1787734064.194984:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705778944 00000100:00100000:2.0:1787734064.195050:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787734064.195060:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15134:x1874574705778944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787734064.195087:0:14446:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787734064.195100:0:14446:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787734064.238784:0:14446:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787734064.238802:0:14446:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787734064.239171:0:14467:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787734064.239177:0:14467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787734064.239200:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734064.239219:0:14467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020c1a00/0x45228d86de4d669d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d6696 expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734064.239228:0:14467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734064.239269:0:14467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020c1a00/0x45228d86de4d669d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d6696 expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734064.239283:0:14467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891f020c1a00/0x45228d86de4d669d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d6696 expref: 16 pid: 14446 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734064.239297:0:14467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1874574705779072:0@lo:104: 00000100:00100000:2.0:1787734064.239359:0:14467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734064.239418:0:14467:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec52a3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787734064.239564:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705779072 00000100:00100000:1.0:1787734064.239572:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705779072 00000100:00100000:1.0:1787734064.239623:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787734064.239632:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:14467:x1874574705779072:12345-0@lo:104: 00010000:00010000:1.0:1787734064.239644:0:14434:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734064.239695:0:14434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787734064.239700:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:14467:x1874574705779072:12345-0@lo:104: Request processed in 70us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734064.239707:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787734064.239769:0:14467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1874574705779072:0@lo:104: 00010000:00010000:2.0:1787734064.239786:0:14467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.239884:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734064.239891:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.239899:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659200 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787734064.239903:0:14439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.239911:0:14439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787734064.239918:0:14439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734064.239924:0:14439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787734064.239959:0:14439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.239966:0:14439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787734064.239991:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.239999:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec6659200/0x45228d86de4d6696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d669d expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734064.240005:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1787734064.240014:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787734064.240017:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3313:1874574705779200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787734064.240022:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734064.240024:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787734064.240063:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734064.240132:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705779200 00000100:00100000:3.0:1787734064.240137:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705779200 00010000:00010000:3.0:1787734064.240256:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020c1a00/0x45228d86de4d669d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d6696 expref: 17 pid: 14446 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734064.240285:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787734064.240292:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:3313:x1874574705779200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787734064.240303:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734064.240308:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020c1a00/0x45228d86de4d669d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d6696 expref: 17 pid: 14446 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240319:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020c1a00/0x45228d86de4d669d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d6696 expref: 17 pid: 14446 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240332:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020c1a00/0x45228d86de4d669d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d6696 expref: 17 pid: 14446 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240346:0:14438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240354:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787734064.240366:0:14438:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001189772s 00010000:00010000:3.0:1787734064.240370:0:14438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240377:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240395:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240401:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240406:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b60000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734064.240410:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240417:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240435:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734064.240445:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787734064.240528:0:14467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734064.240536:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734064.240542:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ef6b60000/0x45228d86de4d6730 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734064.240559:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:3313:x1874574705779200:12345-0@lo:103:ldlm_bl.0 Request processed in 268us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734064.240566:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787734064.240601:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3313:1874574705779200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787734064.254976:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:15134:x1874574705778944:12345-0@lo:253:mount.lustre.0 Request processed in 59908us (60197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734064.255004:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787734064.255316:0:15134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15134:1874574705778944:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787734064.255333:0:15134:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787734064.255336:0:15134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787734064.255338:0:15134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787734064.255339:0:15134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787734064.255340:0:15134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787734064.255342:0:15134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787734064.255343:0:15134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787734064.255344:0:15134:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787734064.255346:0:15134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787734064.255347:0:15134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787734064.255363:0:15134:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787734064.261059:0:15134:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787734064.261461:0:15134:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787734064.261621:0:15134:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787734064.261767:0:15134:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787734064.262505:0:15134:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787734064.262736:0:15134:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787734064.265485:0:15134:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787734064.339559:0:15134:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787734064.339568:0:15134:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787734064.339599:0:15134:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787734064.339673:0:15134:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787734064.339686:0:15134:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787734064.339719:0:15134:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787734064.379576:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787734064.890647:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787734065.402260:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787734065.914333:0:14448:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787734065.914342:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff891efe936000 from 7 10000000:01000000:3.0:1787734065.914348:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787734065.914402:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734065.914416:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734065.914441:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734065.914467:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705779328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787734065.914539:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734065.914583:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef83f1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787734065.914601:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705779328 00000100:00100000:3.0:1787734065.914607:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705779328 00000100:00100000:3.0:1787734065.914647:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787734065.914655:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+15:14448:x1874574705779328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787734065.914667:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734065.914679:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891f020c0800/0x45228d86de4d673e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d6737 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734065.914700:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891f020c0800/0x45228d86de4d673e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d6737 expref: 16 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734065.914710:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891f020c0800/0x45228d86de4d673e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d6737 expref: 16 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734065.914720:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c0800, rc 0) 00000100:00100000:3.0:1787734065.914754:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:14448:x1874574705779328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734065.914760:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787734065.914803:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705779328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787734065.914925:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734065.914940:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734065.914986:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705779456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787734065.915026:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734065.915994:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef83f1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787734065.917367:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705779456 00000100:00100000:0.0:1787734065.917377:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705779456 00000100:00100000:0.0:1787734065.917438:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787734065.917449:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:14448:x1874574705779456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787734065.917474:0:14446:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787734065.917490:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787734065.917494:0:14446:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787734065.917613:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:14448:x1874574705779456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 164us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734065.917620:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787734065.917673:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705779456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787734065.917740:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787734065.917750:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734065.917760:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734066.427441:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734067.452326:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734068.474464:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734069.507099:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787734069.563593:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787734069.563600:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787734069.563603:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787734069.563605:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787734069.563646:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787734069.563666:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705779584:0@lo:400:kworker.0 00000100:00100000:1.0:1787734069.563736:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734069.563780:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705779584 00000100:00100000:0.0:1787734069.563788:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705779584 00000100:00100000:1.0:1787734069.563800:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705779712:0@lo:400:kworker.0 00000100:00100000:1.0:1787734069.563825:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734069.563830:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787734069.563839:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:3312:x1874574705779584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734069.563843:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787734069.563847:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705779840:0@lo:400:kworker.0 00000100:00100000:1.0:1787734069.563865:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734069.563886:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:3312:x1874574705779584:12345-0@lo:400:kworker.0 Request processed in 49us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734069.563893:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705779712 00000100:00100000:1.0:1787734069.563896:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705779712 00000100:00100000:0.0:1787734069.563905:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787734069.563919:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705779840 00000100:00100000:1.0:1787734069.563921:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705779840 00000100:00100000:1.0:1787734069.563962:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787734069.563965:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705779584:0@lo:400:kworker.0 00000100:00100000:1.0:1787734069.563968:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705779712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734069.564001:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705779712:12345-0@lo:400:kworker.0 Request processed in 33us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734069.564007:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787734069.564019:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787734069.564019:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891eeff2f480 x1874574705779712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787734069.564025:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705779840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787734069.564031:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705779712:0@lo:400:kworker.0 00000100:00100000:1.0:1787734069.564081:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705779840:12345-0@lo:400:kworker.0 Request processed in 56us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734069.564087:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787734069.564231:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891eeff2c380 x1874574705779840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787734069.564241:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705779840:0@lo:400:kworker.0 00000100:00080000:3.0:1787734069.564255:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787734069.944148:0:15500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787734070.524850:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734071.550816:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734072.570403:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734073.595280:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787734074.107826:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787734074.618304:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787734074.683820:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705779968:0@lo:400:kworker.0 00000100:00100000:1.0:1787734074.683900:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734074.683984:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705779968 00000100:00100000:3.0:1787734074.683991:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705779968 00000100:00100000:3.0:1787734074.684034:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787734074.684045:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:3312:x1874574705779968:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787734074.684107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787734074.684112:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787734074.684115:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787734074.684118:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787734074.684188:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:3312:x1874574705779968:12345-0@lo:400:kworker.0 Request processed in 144us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734074.684196:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787734074.684303:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705780224:0@lo:400:kworker.0 00000100:00100000:3.0:1787734074.684335:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734074.684386:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705780096:0@lo:400:kworker.0 00000100:00100000:2.0:1787734074.684412:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734074.684573:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705779968:0@lo:400:kworker.0 00000100:00100000:1.0:1787734074.684598:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705780224 00000100:00100000:1.0:1787734074.684602:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705780224 00000100:00100000:1.0:1787734074.684636:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705780096 00000100:00100000:1.0:1787734074.684639:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705780096 00000100:00100000:1.0:1787734074.684652:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787734074.684658:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705780224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734074.684784:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705780224:12345-0@lo:400:kworker.0 Request processed in 126us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734074.684792:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787734074.684805:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787734074.684810:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705780096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734074.684859:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705780096:12345-0@lo:400:kworker.0 Request processed in 40us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734074.684865:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787734074.684889:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787734074.684938:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891efef69500 x1874574705780096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787734074.684951:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705780096:0@lo:400:kworker.0 00010000:00080000:3.0:1787734074.685007:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891efef6b100 x1874574705780224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787734074.685016:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705780224:0@lo:400:kworker.0 00010000:00010000:2.0:1787734075.642374:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787734075.793434:0:15849:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787734075.793438:0:15849:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787734075.793572:0:15849:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff891ec6e5f000 00000020:01000004:0.0:1787734075.793588:0:15849:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787734075.793600:0:15849:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787734075.793615:0:15849:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff891eeea719b8) 00000020:00000080:0.0:1787734075.793630:0:15849:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787734075.810394:0:15849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787734075.810998:0:15849:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787734075.811901:0:15849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787734075.812114:0:15849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787734075.812337:0:15849:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787734075.812759:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 243: rc = 0 00100000:10000000:0.0:1787734075.812935:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 243: rc = 0 00100000:10000000:0.0:1787734075.813025:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 243: rc = 0 00100000:10000000:0.0:1787734075.813511:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 416: rc = 0 00100000:10000000:0.0:1787734075.813893:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 416: rc = 0 00100000:10000000:0.0:1787734075.814226:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 416: rc = 0 00100000:10000000:0.0:1787734075.814466:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 416: rc = 0 00100000:10000000:0.0:1787734075.814774:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 416: rc = 0 00100000:10000000:0.0:1787734075.815096:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 416: rc = 0 00000020:00000080:0.0:1787734075.815906:0:15849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787734075.815919:0:15849:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787734075.815929:0:15849:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x45228d86de4d674c 00000020:01000004:0.0:1787734075.815937:0:15849:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787734075.815956:0:15849:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787734075.815959:0:15849:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787734075.815964:0:15849:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787734075.815986:0:15849:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787734075.815990:0:15849:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787734075.825055:0:15849:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787734075.825093:0:15849:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.134@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787734075.825098:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787734075.825099:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787734075.825101:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787734075.825102:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787734075.825103:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787734075.825105:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787734075.825106:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787734075.825108:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787734075.825109:0:15849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787734075.825113:0:15849:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787734075.825115:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787734075.825117:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787734075.825118:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787734075.825119:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787734075.825120:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787734075.825121:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787734075.825126:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787734075.825127:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787734075.825128:0:15849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787734075.825341:0:15849:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787734075.825361:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780352:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787734075.825435:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.825532:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787734075.825595:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705780352 00000100:00100000:2.0:1787734075.825603:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705780352 00000100:00100000:2.0:1787734075.825656:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787734075.825665:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15849:x1874574705780352:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787734075.825691:0:14446:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787734075.825694:0:14446:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787734075.825697:0:14446:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787734075.831055:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15849:x1874574705780352:12345-0@lo:253:mount.lustre.0 Request processed in 5381us (5610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734075.831070:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787734075.831216:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780352:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787734075.831233:0:15849:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787734075.831236:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787734075.831237:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787734075.831239:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787734075.831240:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787734075.831241:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787734075.831243:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787734075.831244:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787734075.831246:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787734075.831247:0:15849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787734075.831269:0:15849:0:(tgt_mount.c:101:server_register_mount()) register mount ffff891ec6e5f000 from lustre-OST0001 10000000:01000000:0.0:1787734075.831293:0:15849:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787734075.831296:0:15849:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787734075.831304:0:15849:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff891ef6c6b370 local copy 00010000:00010000:0.0:1787734075.831313:0:15849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65c4 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734075.831511:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787734075.831546:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.831619:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed85289c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787734075.831705:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705780480 00000100:00100000:3.0:1787734075.831718:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705780480 00000100:00100000:3.0:1787734075.831807:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787734075.831817:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15849:x1874574705780480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734075.832090:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15849:x1874574705780480:12345-0@lo:501:mount.lustre.0 Request processed in 274us (542us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787734075.832098:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787734075.832188:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780480:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787734075.832203:0:15849:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787734075.832342:0:15849:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787734075.832354:0:15849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65c4 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.832364:0:15849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec60cc800/0x45228d86de4d65bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d65c4 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734075.832384:0:15849:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff891ec6e5f000 10000000:01000000:0.0:1787734075.832389:0:15849:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787734075.832394:0:15849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787734075.832397:0:15849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787734075.832400:0:15849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787734075.832404:0:15849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787734075.832425:0:15849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d6753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.832433:0:15849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d6753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.832442:0:15849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d6753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734075.832456:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787734075.832483:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.832664:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed85289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787734075.832855:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705780608 00000100:00100000:2.0:1787734075.832860:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705780608 00000100:00100000:2.0:1787734075.832885:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787734075.832892:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:15849:x1874574705780608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787734075.832901:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734075.832914:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ef6b60800/0x45228d86de4d675a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d6753 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.832935:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ef6b60800/0x45228d86de4d675a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d6753 expref: 17 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.832945:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ef6b60800/0x45228d86de4d675a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d6753 expref: 17 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.832954:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ef6b60800, rc 0) 00000100:00100000:2.0:1787734075.832997:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:15849:x1874574705780608:12345-0@lo:101:mount.lustre.0 Request processed in 106us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734075.833003:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787734075.833080:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787734075.833091:0:15849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d6753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d675a expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.833100:0:15849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d6753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d675a expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787734075.833704:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787734075.834564:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787734075.835558:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787734075.835636:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787734075.835742:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787734075.836026:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787734075.836068:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787734075.836104:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787734075.836242:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787734075.836251:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787734075.836341:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787734075.836407:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.836489:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787734075.836546:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705780736 00000100:00100000:1.0:1787734075.836554:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705780736 00000100:00100000:2.0:1787734075.836613:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787734075.836623:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:15849:x1874574705780736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787734075.837180:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:15849:x1874574705780736:12345-0@lo:501:mount.lustre.0 Request processed in 531us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734075.837190:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787734075.837318:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787734075.837355:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787734075.837393:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.837423:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787734075.837476:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705780864 00000100:00100000:3.0:1787734075.837481:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705780864 00000100:00100000:3.0:1787734075.837506:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787734075.837514:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:15849:x1874574705780864:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787734075.837940:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:15849:x1874574705780864:12345-0@lo:503:mount.lustre.0 Request processed in 427us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734075.837947:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787734075.838029:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780864:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787734075.839055:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787734075.839127:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787734075.839212:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.839243:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787734075.839341:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705780992 00000100:00100000:2.0:1787734075.839346:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705780992 00000100:00100000:2.0:1787734075.839382:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787734075.839391:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:15849:x1874574705780992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787734075.839580:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:15849:x1874574705780992:12345-0@lo:502:mount.lustre.0 Request processed in 189us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734075.839587:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787734075.839754:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705780992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787734075.840134:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787734075.840224:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787734075.840267:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787734075.840315:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787734075.840349:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787734075.840381:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787734075.840429:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787734075.840475:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787734075.840523:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787734075.840549:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787734075.840589:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.841008:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef6171b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787734075.841078:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705781120 00000100:00100000:2.0:1787734075.841084:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705781120 00000100:00100000:2.0:1787734075.841112:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787734075.841119:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:15849:x1874574705781120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787734075.841322:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:15849:x1874574705781120:12345-0@lo:502:mount.lustre.0 Request processed in 202us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734075.841329:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787734075.841436:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787734075.841507:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787734075.841517:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787734075.842935:0:15850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787734075.842946:0:15850:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787734075.842953:0:15850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.842956:0:15850:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787734075.842961:0:15850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787734075.842976:0:15850:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff891ee57bb370) 00000020:00000080:2.0:1787734075.842996:0:15850:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787734075.843001:0:15850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787734075.843061:0:15850:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891ec6e5f000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787734075.843069:0:15850:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787734075.843076:0:15850:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x45228d86de4d6768 00010000:00010000:0.0:1787734075.848088:0:15850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787734075.848626:0:15850:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787734075.850357:0:15850:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787734075.851893:0:15850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787734075.851906:0:15850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787734075.851912:0:15850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.851915:0:15850:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787734075.851918:0:15850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787734075.851921:0:15850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.851923:0:15850:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787734075.851925:0:15850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787734075.851927:0:15850:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787734075.851929:0:15850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787734075.851931:0:15850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.851932:0:15850:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787734075.851934:0:15850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787734075.851937:0:15850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.851938:0:15850:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787734075.851941:0:15850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787734075.851990:0:15850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787734075.851993:0:15850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.851994:0:15850:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787734075.851997:0:15850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787734075.857740:0:15849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787734075.857783:0:15849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787734075.857815:0:15849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d6753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d675a expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.857856:0:15849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6658a00/0x45228d86de4d6753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d675a expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734075.857866:0:15849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec6e5f000 from 1 10000000:01000000:0.0:1787734075.857870:0:15849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787734075.857917:0:15849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.857925:0:15849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.857944:0:15849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734075.857970:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787734075.858050:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.858092:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38780 going to sleep for 11 seconds 00000100:00100000:2.0:1787734075.858480:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705781248 00000100:00100000:2.0:1787734075.858488:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705781248 00000100:00100000:2.0:1787734075.858622:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787734075.858632:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:15849:x1874574705781248:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787734075.858653:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734075.858665:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ef6b60200/0x45228d86de4d6776 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d676f expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.858687:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ef6b60200/0x45228d86de4d6776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d676f expref: 18 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.858698:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ef6b60200/0x45228d86de4d6776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d676f expref: 18 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.858712:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ef6b60200, rc 0) 00000100:00100000:2.0:1787734075.858755:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705781248:12345-0@lo:101:mount.lustre.0 Request processed in 125us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734075.858762:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787734075.858826:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787734075.858848:0:15849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.858858:0:15849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787734075.859375:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787734075.859639:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787734075.859880:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787734075.859923:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787734075.859985:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787734075.859992:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787734075.860043:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787734075.860084:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.860507:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38780 going to sleep for 11 seconds 00000100:00100000:3.0:1787734075.860586:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705781376 00000100:00100000:3.0:1787734075.860593:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705781376 00000100:00100000:3.0:1787734075.860629:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787734075.860649:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705781376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787734075.860988:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705781376:12345-0@lo:501:mount.lustre.0 Request processed in 351us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734075.860997:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787734075.861076:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787734075.861107:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787734075.861141:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.861189:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38780 going to sleep for 11 seconds 00000100:00100000:3.0:1787734075.861241:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705781504 00000100:00100000:3.0:1787734075.861246:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705781504 00000100:00100000:3.0:1787734075.861264:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787734075.861270:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705781504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787734075.861561:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705781504:12345-0@lo:503:mount.lustre.0 Request processed in 290us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734075.861578:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787734075.863922:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781504:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787734075.864528:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787734075.864604:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787734075.866946:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734075.866997:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efec38780 going to sleep for 11 seconds 00000100:00100000:3.0:1787734075.867069:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705781632 00000100:00100000:3.0:1787734075.867076:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705781632 00000100:00100000:3.0:1787734075.867132:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787734075.867142:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705781632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787734075.867436:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705781632:12345-0@lo:502:mount.lustre.0 Request processed in 294us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734075.867444:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787734075.867581:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787734075.867889:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787734075.867942:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787734075.867989:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787734075.868023:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787734075.868053:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787734075.868110:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787734075.868144:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787734075.868208:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787734075.868243:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787734075.868287:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734075.868320:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d5d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787734075.868852:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705781760 00000100:00100000:3.0:1787734075.868860:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705781760 00000100:00100000:3.0:1787734075.868894:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787734075.868902:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705781760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787734075.869179:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705781760:12345-0@lo:502:mount.lustre.0 Request processed in 277us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734075.869186:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787734075.869455:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787734075.869628:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787734075.870006:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787734075.871006:0:15854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787734075.871017:0:15854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.871019:0:15854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787734075.871026:0:15854:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891ec6e5f000 00000020:00000080:2.0:1787734075.871029:0:15854:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787734075.871035:0:15854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787734075.871038:0:15854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.871039:0:15854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787734075.871042:0:15854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787734075.871044:0:15854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.871045:0:15854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787734075.871048:0:15854:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff891ec6e5f000 00000020:00000080:2.0:1787734075.871050:0:15854:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787734075.871142:0:15854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787734075.871147:0:15854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.871148:0:15854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787734075.871151:0:15854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787734075.871189:0:15854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.871191:0:15854:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787734075.871195:0:15854:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff891ec6e5f000 00000020:00000080:2.0:1787734075.871197:0:15854:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787734075.871736:0:15854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787734075.871742:0:15854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787734075.871744:0:15854:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787734075.871747:0:15854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787734075.874964:0:15849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787734075.875013:0:15849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787734075.875040:0:15849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734075.875054:0:15849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787734075.875106:0:15849:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787734075.875108:0:15849:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff891ec6e5f000 10000000:01000000:1.0:1787734075.875111:0:15849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff891ec6e5f000 10000000:01000000:1.0:1787734075.875115:0:15849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787734075.875121:0:15849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff891ec6e5f000 from 1 10000000:01000000:1.0:1787734075.875123:0:15849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787734075.875172:0:15849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cca00/0x45228d86de4d677d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734075.875192:0:15849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec60cca00/0x45228d86de4d677d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734075.875203:0:15849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec60cca00/0x45228d86de4d677d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734075.875225:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787734075.875288:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734075.879779:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d5d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787734075.879923:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705781888 00000100:00100000:0.0:1787734075.879933:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705781888 00000100:00100000:0.0:1787734075.881884:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787734075.881901:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705781888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787734075.881920:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734075.881939:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec6658200/0x45228d86de4d6784 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d677d expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.881968:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec6658200/0x45228d86de4d6784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d677d expref: 19 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.881980:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec6658200/0x45228d86de4d6784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d677d expref: 19 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.881989:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658200, rc 0) 00000100:00100000:0.0:1787734075.882065:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:15849:x1874574705781888:12345-0@lo:101:mount.lustre.0 Request processed in 170us (6776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734075.882073:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787734075.885731:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705781888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787734075.885759:0:15849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec60cca00/0x45228d86de4d677d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6784 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734075.885772:0:15849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec60cca00/0x45228d86de4d677d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d6784 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787734075.886728:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787734075.887437:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787734075.887964:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787734075.888008:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787734075.888037:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787734075.888081:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787734075.888116:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787734075.888176:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787734075.888206:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787734075.888250:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787734075.888294:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787734075.888322:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787734075.888359:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787734075.888399:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787734075.888427:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787734075.888454:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787734075.888498:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787734075.888534:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787734075.888567:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787734075.888628:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787734075.888736:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787734075.888772:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787734075.889970:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787734075.890018:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787734075.890053:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787734075.890118:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787734075.890183:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787734075.890221:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787734075.890270:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787734075.890305:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787734075.890340:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787734075.890389:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787734075.890423:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787734075.890457:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787734075.890490:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787734075.890537:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787734075.890574:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787734075.890620:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787734075.894253:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787734075.894382:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787734075.894392:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787734075.894491:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705782016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787734075.894556:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734075.894599:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d5d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787734075.895246:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705782016 00000100:00100000:0.0:1787734075.895255:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705782016 00000100:00100000:0.0:1787734075.895310:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787734075.895320:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:15849:x1874574705782016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787734075.895562:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:15849:x1874574705782016:12345-0@lo:501:mount.lustre.0 Request processed in 243us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734075.895576:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787734075.896116:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705782016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787734075.896173:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705782144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787734075.896214:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734075.896241:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d5d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787734075.897241:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705782144 00000100:00100000:0.0:1787734075.897249:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705782144 00000100:00100000:0.0:1787734075.897291:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787734075.897300:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:15849:x1874574705782144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787734075.897601:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:15849:x1874574705782144:12345-0@lo:503:mount.lustre.0 Request processed in 301us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734075.897609:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787734075.897749:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705782144:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787734075.898340:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787734075.898415:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705782272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787734075.898457:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734075.898489:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d5d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787734075.898740:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705782272 00000100:00100000:0.0:1787734075.898745:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705782272 00000100:00100000:0.0:1787734075.898772:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787734075.898778:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:15849:x1874574705782272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787734075.900223:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:15849:x1874574705782272:12345-0@lo:502:mount.lustre.0 Request processed in 1437us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734075.900235:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787734075.900777:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705782272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787734075.901203:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787734075.901266:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787734075.901299:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787734075.901344:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787734075.901380:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787734075.901428:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787734075.901467:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787734075.901498:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787734075.901551:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787734075.901587:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787734075.901620:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787734075.903516:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787734075.903577:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787734075.903612:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787734075.904056:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787734075.904091:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787734075.904118:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787734075.904731:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787734075.904783:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787734075.904898:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787734075.904948:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787734075.904985:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787734075.905018:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787734075.905066:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787734075.905100:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787734075.905127:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787734075.905962:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787734075.906030:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787734075.906065:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787734075.906106:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787734075.906152:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787734075.906905:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787734075.906943:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787734075.906999:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787734075.907039:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787734075.907092:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787734075.907131:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787734075.907742:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787734075.907885:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787734075.907926:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787734075.907978:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705782400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787734075.908060:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734075.909737:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d5d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787734075.910448:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705782400 00000100:00100000:2.0:1787734075.910464:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705782400 00000100:00100000:2.0:1787734075.910550:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787734075.910561:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:15849:x1874574705782400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787734075.910952:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:15849:x1874574705782400:12345-0@lo:502:mount.lustre.0 Request processed in 393us (2891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734075.910961:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787734075.911119:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705782400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787734075.911242:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787734075.911257:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787734075.912334:0:15859:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787734075.912349:0:15859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff891dc54b8000) 00000020:00000080:1.0:1787734075.912370:0:15859:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787734075.912456:0:15859:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891ec6e5f000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787734075.912461:0:15859:0:(tgt_mount.c:187:server_put_mount()) put mount ffff891ec6e5f000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787734075.912463:0:15859:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891ec6e5f000 3 00010000:00080000:1.0:1787734075.912492:0:15859:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891ef6c89800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1787734075.914070:0:15859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787734075.914315:0:15859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787734075.914349:0:15859:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787734075.914361:0:15859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x45228d86de4d6792 00000100:00080000:1.0:1787734075.914371:0:15859:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787734075.914376:0:15859:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff891ef6c89800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787734075.914410:0:15859:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891eeff2d500 x1874574705782528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787734075.914442:0:15859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787734075.914468:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787734075.914472:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787734075.914475:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787734075.914478:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787734075.914531:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705782656:0@lo:400:kworker.0 00000100:00100000:1.0:1787734075.914592:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734075.914639:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705782784:0@lo:400:kworker.0 00000100:00100000:1.0:1787734075.914662:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734075.914688:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705782656 00000100:00100000:1.0:1787734075.914694:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705782656 00000100:00100000:1.0:1787734075.914725:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705782784 00000100:00100000:1.0:1787734075.914728:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705782784 00000100:00100000:1.0:1787734075.914743:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787734075.914758:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705782656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734075.914807:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874574705782656:12345-0@lo:400:kworker.0 Request processed in 49us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734075.914813:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787734075.914826:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787734075.914846:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705782784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734075.914875:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705782784:12345-0@lo:400:kworker.0 Request processed in 30us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734075.914881:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787734075.914917:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891eeff2c380 x1874574705782784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787734075.914931:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705782784:0@lo:400:kworker.0 00010000:00080000:1.0:1787734075.914955:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891eeff2f100 x1874574705782656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787734075.914963:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874574705782656:0@lo:400:kworker.0 00000100:00100000:2.0:1787734075.916672:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874574705782528:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787734075.916727:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734075.919028:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705782528 00000100:00100000:3.0:1787734075.919039:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705782528 00000100:00100000:3.0:1787734075.919077:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787734075.919085:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874574705782528:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787734075.919110:0:14452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:3.0:1787734075.919145:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x45228d86de4d6799 00000004:00100000:3.0:1787734075.919177:0:14452:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787734075.919207:0:14452:0:(import.c:65:import_set_state_nolock()) ffff891ed1dd6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787734075.919279:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874574705782528:12345-0@lo:38:llog_process_th.0 Request processed in 193us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734075.919296:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787734075.919345:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891eeff2d500 x1874574705782528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787734085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787734075.919356:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787734075.919364:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787734075.919371:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787734075.919376:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787734075.919378:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ef6c89800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787734075.919385:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874574705782528:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787734075.923298:0:15859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787734075.923512:0:15849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787734075.923540:0:15849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787734075.923564:0:15849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec60cca00/0x45228d86de4d677d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6784 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734075.923576:0:15849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec60cca00/0x45228d86de4d677d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d6784 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787734075.923620:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787734075.923622:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787734075.923623:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787734075.923624:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787734075.923626:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787734075.923627:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787734075.923628:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787734075.923630:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787734075.923631:0:15849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787734075.923635:0:15849:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787734075.923717:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787734075.923719:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787734075.923725:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787734075.923726:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787734075.923727:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787734075.923729:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787734075.923730:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787734075.923731:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787734075.923732:0:15849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787734075.923757:0:15849:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787734075.923775:0:15849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705782912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787734075.923913:0:15849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734075.923953:0:15849:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec7d5a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787734075.924000:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705782912 00000100:00100000:0.0:1787734075.924006:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705782912 00000100:00100000:0.0:1787734075.924048:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787734075.924056:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:15849:x1874574705782912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787734075.924082:0:14445:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787734075.924095:0:14445:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787734075.946923:0:14445:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787734075.946978:0:14445:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787734075.947747:0:14467:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787734075.947754:0:14467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787734075.947778:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.947913:0:14467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891f020c0800/0x45228d86de4d673e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d6737 expref: 19 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.947923:0:14467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.947962:0:14467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891f020c0800/0x45228d86de4d673e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d6737 expref: 19 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.947978:0:14467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891f020c0800/0x45228d86de4d673e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d6737 expref: 19 pid: 14444 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734075.947994:0:14467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1874574705783040:0@lo:104: 00000100:00100000:2.0:1787734075.948064:0:14467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734075.948111:0:14467:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec52a3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787734075.948195:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705783040 00000100:00100000:0.0:1787734075.948203:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705783040 00000100:00100000:0.0:1787734075.948257:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787734075.948280:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:14467:x1874574705783040:12345-0@lo:104: 00010000:00010000:0.0:1787734075.948294:0:14435:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948350:0:14435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787734075.948356:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:14467:x1874574705783040:12345-0@lo:104: Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734075.948362:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787734075.948385:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734075.948392:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948399:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1a00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1787734075.948403:0:14440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948411:0:14440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787734075.948419:0:14440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734075.948425:0:14440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787734075.948452:0:14440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948458:0:14440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787734075.948475:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948493:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020c1a00/0x45228d86de4d6737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d673e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948511:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734075.948512:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734075.948514:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787734075.948528:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787734075.948539:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705783168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787734075.948569:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734075.948608:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705783168 00000100:00100000:0.0:1787734075.948612:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705783168 00010000:00010000:0.0:1787734075.948628:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891f020c0800/0x45228d86de4d673e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d6737 expref: 20 pid: 14444 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734075.948662:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787734075.948669:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+20:3312:x1874574705783168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787734075.948680:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787734075.948685:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891f020c0800/0x45228d86de4d673e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d6737 expref: 20 pid: 14444 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948695:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891f020c0800/0x45228d86de4d673e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d6737 expref: 20 pid: 14444 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948710:0:14437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948717:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787734075.948740:0:14437:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001189772s 00010000:00010000:0.0:1787734075.948745:0:14437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948752:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948758:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948765:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948771:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b61400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734075.948775:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948782:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948917:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734075.948928:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787734075.948957:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+20:3312:x1874574705783168:12345-0@lo:103:ldlm_bl.0 Request processed in 289us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734075.948964:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787734075.948996:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705783168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787734075.949089:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891f020c0800/0x45228d86de4d673e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d6737 expref: 19 pid: 14444 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734075.949105:0:14467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1874574705783040:0@lo:104: 00010000:00010000:2.0:1787734075.949118:0:14467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.949127:0:14467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.949132:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734075.949139:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ef6b61400/0x45228d86de4d67a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734075.956120:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:15849:x1874574705782912:12345-0@lo:253:mount.lustre.0 Request processed in 32055us (32199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734075.956136:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787734075.956256:0:15849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:15849:1874574705782912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787734075.956272:0:15849:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787734075.956275:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787734075.956276:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787734075.956278:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787734075.956279:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787734075.956280:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787734075.956281:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787734075.956283:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787734075.956285:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787734075.956287:0:15849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787734075.956302:0:15849:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787734075.962679:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787734075.963014:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787734075.963243:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787734075.963400:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787734075.963561:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787734075.966579:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787734075.968339:0:15849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787734076.022435:0:15849:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787734076.022459:0:15849:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787734076.022497:0:15849:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787734076.022631:0:15849:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787734076.022707:0:15849:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787734076.022737:0:15849:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787734076.666766:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787734077.114257:0:14448:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787734077.114265:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff891efe936000 from 8 10000000:01000000:0.0:1787734077.114270:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787734077.114317:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d67a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.114330:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d67a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.114341:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d67a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734077.114368:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705783296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787734077.114440:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734077.114492:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705783296 00000100:00100000:0.0:1787734077.114500:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3c8ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787734077.114501:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705783296 00000100:00100000:2.0:1787734077.114578:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787734077.114588:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:14448:x1874574705783296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787734077.114601:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734077.114615:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ef6b60400/0x45228d86de4d67ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d67a7 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.114656:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ef6b60400/0x45228d86de4d67ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d67a7 expref: 19 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.114687:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ef6b60400/0x45228d86de4d67ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d67a7 expref: 19 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.114696:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ef6b60400, rc 0) 00000100:00100000:2.0:1787734077.114746:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:14448:x1874574705783296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734077.114753:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787734077.114802:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705783296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787734077.114829:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d67a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d67ae expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.114839:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d67a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d67ae expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734077.114888:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705783424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787734077.114921:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734077.114965:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec3d376c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787734077.115088:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705783424 00000100:00100000:0.0:1787734077.115093:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705783424 00000100:00100000:0.0:1787734077.115127:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787734077.115135:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:14448:x1874574705783424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787734077.115148:0:14446:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787734077.115188:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787734077.115191:0:14446:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787734077.115281:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:14448:x1874574705783424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734077.115288:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787734077.115310:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705783424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787734077.115368:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787734077.115374:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d67a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d67ae expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.115383:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6659800/0x45228d86de4d67a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d67ae expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734077.691811:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787734077.947526:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787734062/real 1787734062] req@ffff891eeff2c700 x1874574705776128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787734077 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787734077.947578:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff891eeff2c700 x1874574705776128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787734077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787734077.947588:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787734062/real 1787734062] req@ffff891eeff2ce00 x1874574705776256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787734077 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787734077.947598:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff891eeff2ce00 x1874574705776256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787734077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787734077.947616:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891efee5c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787734077.948501:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787734077.948507:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705776128:0@lo:8:kworker.0 00000100:00080000:3.0:1787734077.948514:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ec6320800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787734077.949610:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787734077.949618:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787734077.949622:0:36:0:(import.c:65:import_set_state_nolock()) ffff891efee5c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787734077.949629:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 380 00000100:00080000:2.0:1787734077.949635:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787734077.949643:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff891efee5c800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787734077.949677:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891efef6b800 x1874574705783552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787734077.949693:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787734077.949697:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787734077.949699:0:36:0:(import.c:65:import_set_state_nolock()) ffff891ec6320800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787734077.949703:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 380 00000100:00080000:2.0:1787734077.949706:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787734077.949710:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff891ec6320800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787734077.949723:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891efef6b100 x1874574705783680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787734077.949811:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705783808:0@lo:400:kworker.0 00000100:00100000:2.0:1787734077.949880:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734077.949936:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787734077.949943:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705783936:0@lo:400:kworker.0 00000100:00100000:2.0:1787734077.949971:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734077.949999:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705784064:0@lo:400:kworker.0 00000100:00100000:2.0:1787734077.950021:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734077.950058:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705783808 00000100:00100000:2.0:1787734077.950065:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705783808 00000100:00100000:2.0:1787734077.950097:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705783936 00000100:00100000:2.0:1787734077.950100:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705783936 00000100:00100000:2.0:1787734077.950125:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705784064 00000100:00100000:2.0:1787734077.950128:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705784064 00000100:00100000:2.0:1787734077.950148:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787734077.950179:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705783808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734077.950230:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705783808:12345-0@lo:400:kworker.0 Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734077.950238:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787734077.950254:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787734077.950260:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705783936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734077.950286:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705783936:12345-0@lo:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734077.950292:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787734077.950302:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787734077.950308:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705784064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734077.950338:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705784064:12345-0@lo:400:kworker.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734077.950344:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787734077.950383:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787734077.950413:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efef6a300 x1874574705784064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787734077.950427:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705784064:0@lo:400:kworker.0 00010000:00080000:2.0:1787734077.950453:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efef6b480 x1874574705783936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787734077.950462:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705783936:0@lo:400:kworker.0 00010000:00080000:2.0:1787734077.950476:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efef68380 x1874574705783808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787734077.950485:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705783808:0@lo:400:kworker.0 00000100:00080000:3.0:1787734077.951100:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787734077.951108:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705776256:0@lo:8:kworker.0 00000100:00100000:3.0:1787734077.951134:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705783552:0@lo:8:kworker.0 00000100:00100000:3.0:1787734077.951192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734077.951226:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705783552 00000100:00100000:3.0:1787734077.951231:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705783680:0@lo:8:kworker.0 00000100:00100000:0.0:1787734077.951238:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705783552 00000100:00100000:3.0:1787734077.951263:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734077.954476:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705783680 00000100:00100000:0.0:1787734077.954490:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705783680 00000100:00100000:2.0:1787734077.954496:0:15137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787734077.954508:0:15137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874574705783552:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787734077.954542:0:15137:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:2.0:1787734077.954572:0:15137:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45228d86de4d67b5 00002000:00100000:2.0:1787734077.954588:0:15137:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff891ef032c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787734077.954592:0:15137:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787734077.954595:0:15137:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787734077.954993:0:15137:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787734077.955019:0:15137:0:(import.c:65:import_set_state_nolock()) ffff891ef032d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787734077.955171:0:15137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874574705783552:12345-0@lo:8:kworker.0 Request processed in 645us (3959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734077.955179:0:15137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787734077.955198:0:15137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787734077.955204:0:15137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874574705783680:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787734077.955234:0:15137:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:2.0:1787734077.955252:0:15137:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45228d86de4d67bc 00002000:00100000:2.0:1787734077.955259:0:15137:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff891ef032a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787734077.955263:0:15137:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787734077.955265:0:15137:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787734077.955477:0:15137:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787734077.955492:0:15137:0:(import.c:65:import_set_state_nolock()) ffff891ef0329800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787734077.955526:0:15137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874574705783680:12345-0@lo:8:kworker.0 Request processed in 320us (4262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734077.955533:0:15137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787734077.956756:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efef6b800 x1874574705783552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787734097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787734077.956770:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787734077.956778:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787734077.956786:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787734077.956801:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787734077.956811:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891efee5c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787734077.956825:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787734077.956830:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705783552:0@lo:8:kworker.0 00010000:00080000:3.0:1787734077.956851:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efef6b100 x1874574705783680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787734097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787734077.956859:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787734077.956863:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787734077.956868:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787734077.956872:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787734077.956875:0:3309:0:(import.c:65:import_set_state_nolock()) ffff891ec6320800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787734077.956891:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787734077.956895:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874574705783680:0@lo:8:kworker.0 00000004:00080000:1.0:1787734077.957070:0:14475:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787734077.957945:0:14474:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787734077.957969:0:14474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14474:1874574705784448:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787734077.958026:0:14474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787734077.958029:0:14476:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787734077.958052:0:14476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14476:1874574705784576:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787734077.958056:0:14474:0:(client.c:2715:ptlrpc_set_wait()) set ffff891efea8f000 going to sleep for 11 seconds 00000004:00080000:2.0:1787734077.958071:0:14473:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787734077.958091:0:14476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734077.958112:0:14476:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b93c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787734077.958381:0:14473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395947224061ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787734077.958413:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705784320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787734077.958444:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734077.958477:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787734077.958487:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705784192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787734077.958519:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734077.958558:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705784320 00000100:00100000:2.0:1787734077.958563:0:15137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705784448 00000100:00100000:0.0:1787734077.958566:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705784320 00000100:00100000:2.0:1787734077.958569:0:15137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705784448 00000100:00100000:0.0:1787734077.958625:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705784192 00000100:00100000:0.0:1787734077.958629:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705784192 00000100:00100000:0.0:1787734077.958647:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000004:00080000:1.0:1787734077.958711:0:14475:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395947553862ns, next at 0ns, rc = 0 00000100:00080000:2.0:1787734077.964053:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787734077.964063:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787734077.964254:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705784576 00000100:00100000:2.0:1787734077.964266:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705784576 00000100:00100000:2.0:1787734077.964331:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787734077.964344:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14476:x1874574705784576:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787734077.964420:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705784320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787734077.964607:0:15140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787734077.964682:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874574705784320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6026us (6237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734077.964690:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787734077.964778:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787734077.964786:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874574705784192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787734077.964814:0:15140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787734077.964856:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874574705784192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (6337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734077.964862:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787734077.964924:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891efef68380 x1874574705784320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787734093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787734077.964945:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705784320:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787734077.964990:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891ec60ca300 x1874574705784192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787734093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787734077.965013:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705784192:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1787734077.969432:0:15136:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787734077.969443:0:15136:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787734077.969449:0:15136:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1787734077.977975:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.977990:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.978138:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.978144:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.978151:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.978213:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.978226:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.978235:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.978254:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787734077.978269:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787734077.978275:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.978298:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b61600 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787734077.978304:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.978313:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.978331:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.978340:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.978358:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734077.978360:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734077.978362:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.979386:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.979396:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c16fce23/0x45228d86de4d67ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.979409:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.979414:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.979420:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c16fce23/0x45228d86de4d67ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.979433:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c16fce23/0x45228d86de4d67ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.979452:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c16fce23/0x45228d86de4d67ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.979461:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c16fce23/0x45228d86de4d67ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.979491:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734077.979500:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734077.979509:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c16fce23/0x45228d86de4d67ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.979520:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b60a00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734077.979525:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c16fce23/0x45228d86de4d67ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.979536:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c16fce23/0x45228d86de4d67ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.979554:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c16fce23/0x45228d86de4d67ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.979562:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c16fce23/0x45228d86de4d67ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.979599:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.979601:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.979610:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.980485:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.980494:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000003e0d5a/0x45228d86de4d67d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.980504:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.980508:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.980513:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000003e0d5a/0x45228d86de4d67d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.980525:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000003e0d5a/0x45228d86de4d67d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.980535:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000003e0d5a/0x45228d86de4d67d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.980542:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000003e0d5a/0x45228d86de4d67d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.980574:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734077.980599:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.980612:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000003e0d5a/0x45228d86de4d67d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.980623:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b60c00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.980628:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000003e0d5a/0x45228d86de4d67d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.980638:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000003e0d5a/0x45228d86de4d67d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.980656:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000003e0d5a/0x45228d86de4d67d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.980664:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000003e0d5a/0x45228d86de4d67d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.980683:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.980685:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.980687:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.981464:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.981473:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cb59f1b/0x45228d86de4d67d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.981484:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.981488:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.981493:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cb59f1b/0x45228d86de4d67d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.981502:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cb59f1b/0x45228d86de4d67d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.981512:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cb59f1b/0x45228d86de4d67d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.981520:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cb59f1b/0x45228d86de4d67d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.981541:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734077.981568:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.981575:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cb59f1b/0x45228d86de4d67d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.981585:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b61800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.981596:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cb59f1b/0x45228d86de4d67d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.981606:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cb59f1b/0x45228d86de4d67d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.981621:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cb59f1b/0x45228d86de4d67d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.981628:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cb59f1b/0x45228d86de4d67d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.981646:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.981649:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.981651:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.982423:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.982431:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0047e8d/0x45228d86de4d67df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.982441:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.982448:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.982453:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0047e8d/0x45228d86de4d67df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.982462:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0047e8d/0x45228d86de4d67df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.982470:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0047e8d/0x45228d86de4d67df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.982478:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0047e8d/0x45228d86de4d67df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.982501:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734077.982524:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734077.982532:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0047e8d/0x45228d86de4d67df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.982542:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b60000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734077.982547:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0047e8d/0x45228d86de4d67df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.982556:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0047e8d/0x45228d86de4d67df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.982571:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0047e8d/0x45228d86de4d67df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.982579:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0047e8d/0x45228d86de4d67df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.982596:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.982599:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.982607:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.983409:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.983417:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ef49175/0x45228d86de4d67e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.983427:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.983430:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.983434:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef49175/0x45228d86de4d67e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.983443:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ef49175/0x45228d86de4d67e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.983451:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ef49175/0x45228d86de4d67e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.983467:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ef49175/0x45228d86de4d67e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.983486:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787734077.983497:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787734077.983502:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ef49175/0x45228d86de4d67e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.983510:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b61400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787734077.983514:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ef49175/0x45228d86de4d67e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.983523:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ef49175/0x45228d86de4d67e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.983535:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ef49175/0x45228d86de4d67e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.983543:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef49175/0x45228d86de4d67e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.983558:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734077.983560:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734077.983562:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.984558:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.984574:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1b17716/0x45228d86de4d67ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.984585:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.984589:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.984594:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1b17716/0x45228d86de4d67ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.984605:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1b17716/0x45228d86de4d67ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.984614:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1b17716/0x45228d86de4d67ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.984622:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1b17716/0x45228d86de4d67ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.984648:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734077.984681:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.984690:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1b17716/0x45228d86de4d67ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.984699:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b60e00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.984704:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1b17716/0x45228d86de4d67ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.984880:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1b17716/0x45228d86de4d67ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.984898:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1b17716/0x45228d86de4d67ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.984914:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1b17716/0x45228d86de4d67ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.985247:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.985251:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.985254:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.985640:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.985646:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.985655:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.985658:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.985662:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.985790:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.985883:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.985893:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.985976:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787734077.985983:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734077.985992:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734077.986002:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b61600 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734077.986005:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734077.986015:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734077.986033:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734077.986053:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051e652ac/0x45228d86de4d67f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734077.986071:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734077.986074:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734077.986076:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.987630:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.987640:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b512502/0x45228d86de4d67fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.987653:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.987657:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.987663:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b512502/0x45228d86de4d67fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.987803:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b512502/0x45228d86de4d67fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.987870:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b512502/0x45228d86de4d67fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.987880:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b512502/0x45228d86de4d67fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.987959:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734077.987970:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.987978:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b512502/0x45228d86de4d67fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.987988:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b61e00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.987993:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b512502/0x45228d86de4d67fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.988003:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b512502/0x45228d86de4d67fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.988021:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b512502/0x45228d86de4d67fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.988028:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b512502/0x45228d86de4d67fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.988045:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.988047:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.988048:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.989140:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.989150:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ec302ca/0x45228d86de4d6802 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.989183:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.989187:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.989193:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ec302ca/0x45228d86de4d6802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.989205:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ec302ca/0x45228d86de4d6802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.989215:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ec302ca/0x45228d86de4d6802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.989223:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ec302ca/0x45228d86de4d6802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.989241:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734077.989284:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.989291:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ec302ca/0x45228d86de4d6802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.989300:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b61200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.989305:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ec302ca/0x45228d86de4d6802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.989314:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ec302ca/0x45228d86de4d6802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.989329:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ec302ca/0x45228d86de4d6802 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.989336:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ec302ca/0x45228d86de4d6802 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.989364:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.989367:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.989370:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.990287:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.990308:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e88a392/0x45228d86de4d6809 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.990318:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.990327:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.990332:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e88a392/0x45228d86de4d6809 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.990341:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e88a392/0x45228d86de4d6809 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.990348:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e88a392/0x45228d86de4d6809 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.990355:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e88a392/0x45228d86de4d6809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.990374:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734077.990682:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.990689:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e88a392/0x45228d86de4d6809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.990698:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de3a00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.990702:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e88a392/0x45228d86de4d6809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.990732:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e88a392/0x45228d86de4d6809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.990743:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e88a392/0x45228d86de4d6809 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.990831:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e88a392/0x45228d86de4d6809 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.991108:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.991111:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.991113:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.991491:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.991500:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014d083b5/0x45228d86de4d6810 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.991512:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.991516:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.991521:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014d083b5/0x45228d86de4d6810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.991532:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014d083b5/0x45228d86de4d6810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.991541:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014d083b5/0x45228d86de4d6810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.991556:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014d083b5/0x45228d86de4d6810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.991573:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734077.991580:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.991586:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014d083b5/0x45228d86de4d6810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.991595:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de3e00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.991600:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014d083b5/0x45228d86de4d6810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.991608:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014d083b5/0x45228d86de4d6810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.991621:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014d083b5/0x45228d86de4d6810 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.991640:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014d083b5/0x45228d86de4d6810 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.991660:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.991662:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.991665:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.992461:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.992471:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc271adb/0x45228d86de4d6817 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.992481:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.992485:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.992490:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc271adb/0x45228d86de4d6817 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.992500:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc271adb/0x45228d86de4d6817 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.992509:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc271adb/0x45228d86de4d6817 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.992517:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc271adb/0x45228d86de4d6817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.992536:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734077.992561:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.992568:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc271adb/0x45228d86de4d6817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.992577:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de2600 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.992582:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc271adb/0x45228d86de4d6817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.992590:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc271adb/0x45228d86de4d6817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.992603:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc271adb/0x45228d86de4d6817 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.992611:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc271adb/0x45228d86de4d6817 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.992633:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.992636:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.992638:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.993524:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.993533:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000070408bc/0x45228d86de4d681e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.993552:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.993556:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.993561:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000070408bc/0x45228d86de4d681e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.993572:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000070408bc/0x45228d86de4d681e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.993581:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000070408bc/0x45228d86de4d681e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.993588:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000070408bc/0x45228d86de4d681e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.993605:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787734077.994499:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787734077.994508:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.994517:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000070408bc/0x45228d86de4d681e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787734077.994523:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787734077.994531:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de2e00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.994536:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000070408bc/0x45228d86de4d681e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.994545:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000070408bc/0x45228d86de4d681e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.994563:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000070408bc/0x45228d86de4d681e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.994571:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000070408bc/0x45228d86de4d681e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787734077.994590:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787734077.994591:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.994594:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.994598:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734077.994600:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac7a1262/0x45228d86de4d6825 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.994610:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.994613:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.994617:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac7a1262/0x45228d86de4d6825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.994639:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac7a1262/0x45228d86de4d6825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.994647:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac7a1262/0x45228d86de4d6825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.994654:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac7a1262/0x45228d86de4d6825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.994803:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734077.995085:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.995091:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac7a1262/0x45228d86de4d6825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.995099:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de3400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.995103:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac7a1262/0x45228d86de4d6825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.995123:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac7a1262/0x45228d86de4d6825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.995135:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac7a1262/0x45228d86de4d6825 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.995143:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac7a1262/0x45228d86de4d6825 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.995181:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.995183:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.995185:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.995868:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.995876:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000485dc916/0x45228d86de4d682c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.995887:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.995890:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.995895:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000485dc916/0x45228d86de4d682c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.995914:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000485dc916/0x45228d86de4d682c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.995923:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000485dc916/0x45228d86de4d682c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.995943:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000485dc916/0x45228d86de4d682c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.995960:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734077.995983:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734077.995990:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000485dc916/0x45228d86de4d682c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.995998:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de2800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734077.996002:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000485dc916/0x45228d86de4d682c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.996011:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000485dc916/0x45228d86de4d682c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.996026:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000485dc916/0x45228d86de4d682c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.996044:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000485dc916/0x45228d86de4d682c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734077.996060:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.996062:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734077.996064:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.996421:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.996427:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089c779bb/0x45228d86de4d6833 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.996435:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.996438:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.996442:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089c779bb/0x45228d86de4d6833 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.996451:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089c779bb/0x45228d86de4d6833 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.996457:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089c779bb/0x45228d86de4d6833 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.996464:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089c779bb/0x45228d86de4d6833 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.996487:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734077.996645:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734077.996652:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089c779bb/0x45228d86de4d6833 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.996670:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de2000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734077.996674:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089c779bb/0x45228d86de4d6833 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.996682:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089c779bb/0x45228d86de4d6833 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.996695:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089c779bb/0x45228d86de4d6833 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.996702:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089c779bb/0x45228d86de4d6833 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.996726:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.996728:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.996730:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.997419:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.997426:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010c35964/0x45228d86de4d683a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.997442:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.997445:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.997450:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010c35964/0x45228d86de4d683a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.997461:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010c35964/0x45228d86de4d683a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.997469:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010c35964/0x45228d86de4d683a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.997477:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010c35964/0x45228d86de4d683a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.997500:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734077.997893:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734077.997899:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010c35964/0x45228d86de4d683a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.997909:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de3c00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734077.997914:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010c35964/0x45228d86de4d683a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.997922:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010c35964/0x45228d86de4d683a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.997944:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010c35964/0x45228d86de4d683a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.997951:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010c35964/0x45228d86de4d683a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.997969:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.997971:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.997974:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.998362:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.998368:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000177373b9/0x45228d86de4d6841 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.998376:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.998379:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.998383:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000177373b9/0x45228d86de4d6841 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.998391:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000177373b9/0x45228d86de4d6841 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.998409:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000177373b9/0x45228d86de4d6841 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.998415:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000177373b9/0x45228d86de4d6841 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.998438:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734077.998673:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734077.998679:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000177373b9/0x45228d86de4d6841 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.998687:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de2a00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734077.998691:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000177373b9/0x45228d86de4d6841 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.998699:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000177373b9/0x45228d86de4d6841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.998721:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000177373b9/0x45228d86de4d6841 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.998729:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000177373b9/0x45228d86de4d6841 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.998936:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.998938:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.998940:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734077.999312:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734077.999319:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002180a341/0x45228d86de4d6848 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.999328:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734077.999331:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734077.999336:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002180a341/0x45228d86de4d6848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.999346:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002180a341/0x45228d86de4d6848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.999354:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002180a341/0x45228d86de4d6848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.999361:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002180a341/0x45228d86de4d6848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734077.999395:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734077.999427:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734077.999433:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002180a341/0x45228d86de4d6848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.999442:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de2c00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734077.999446:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002180a341/0x45228d86de4d6848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.999455:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002180a341/0x45228d86de4d6848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.999470:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002180a341/0x45228d86de4d6848 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.999477:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002180a341/0x45228d86de4d6848 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734077.999492:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.999494:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734077.999496:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.000253:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.000259:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000204e3d20/0x45228d86de4d684f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.000268:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734078.000271:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.000275:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000204e3d20/0x45228d86de4d684f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.000284:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000204e3d20/0x45228d86de4d684f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.000291:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000204e3d20/0x45228d86de4d684f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.000298:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000204e3d20/0x45228d86de4d684f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.000309:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.000376:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.000383:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000204e3d20/0x45228d86de4d684f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.000405:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de2200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.000410:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000204e3d20/0x45228d86de4d684f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.000419:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000204e3d20/0x45228d86de4d684f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.000435:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000204e3d20/0x45228d86de4d684f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.000442:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000204e3d20/0x45228d86de4d684f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.000462:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.000464:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.000468:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.000987:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.000994:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2de208e/0x45228d86de4d6856 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.001126:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734078.001136:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.001142:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2de208e/0x45228d86de4d6856 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.001151:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2de208e/0x45228d86de4d6856 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.001179:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2de208e/0x45228d86de4d6856 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.001187:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2de208e/0x45228d86de4d6856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.001203:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.001355:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.001362:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2de208e/0x45228d86de4d6856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.001371:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de2400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.001375:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2de208e/0x45228d86de4d6856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.001383:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2de208e/0x45228d86de4d6856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.001403:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2de208e/0x45228d86de4d6856 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.001412:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2de208e/0x45228d86de4d6856 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.001430:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.001432:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.001433:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.001626:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.001633:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff1b6a62/0x45228d86de4d685d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.001641:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734078.001644:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.001649:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff1b6a62/0x45228d86de4d685d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.001658:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff1b6a62/0x45228d86de4d685d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.001666:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff1b6a62/0x45228d86de4d685d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.001806:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff1b6a62/0x45228d86de4d685d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.001890:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.002357:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.002364:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff1b6a62/0x45228d86de4d685d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.002374:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de3600 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.002377:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff1b6a62/0x45228d86de4d685d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.002386:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff1b6a62/0x45228d86de4d685d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.002402:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff1b6a62/0x45228d86de4d685d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.002409:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff1b6a62/0x45228d86de4d685d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.002440:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.002443:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.002445:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.002546:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.002553:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073b5826b/0x45228d86de4d6864 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.002562:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734078.002566:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.002571:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073b5826b/0x45228d86de4d6864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.002579:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073b5826b/0x45228d86de4d6864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.002587:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073b5826b/0x45228d86de4d6864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.002594:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073b5826b/0x45228d86de4d6864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.002615:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.002634:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.002641:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073b5826b/0x45228d86de4d6864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.002649:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de3200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.002652:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073b5826b/0x45228d86de4d6864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.002660:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073b5826b/0x45228d86de4d6864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.002672:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073b5826b/0x45228d86de4d6864 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.002679:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073b5826b/0x45228d86de4d6864 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.002692:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.002694:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.002696:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.004207:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.004219:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a7469f/0x45228d86de4d686b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.004240:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734078.004244:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.004250:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a7469f/0x45228d86de4d686b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.004259:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7a7469f/0x45228d86de4d686b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.004268:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a7469f/0x45228d86de4d686b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.004276:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a7469f/0x45228d86de4d686b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.004303:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.004338:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.004345:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7a7469f/0x45228d86de4d686b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.004368:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de3800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.004371:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a7469f/0x45228d86de4d686b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.004377:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a7469f/0x45228d86de4d686b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.004389:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7a7469f/0x45228d86de4d686b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.004394:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7a7469f/0x45228d86de4d686b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.004407:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.004409:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.004410:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.005232:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.005242:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002246099d/0x45228d86de4d6872 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.005253:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734078.005257:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.005262:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002246099d/0x45228d86de4d6872 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.005272:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002246099d/0x45228d86de4d6872 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.005292:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002246099d/0x45228d86de4d6872 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.005300:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002246099d/0x45228d86de4d6872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.005324:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.005403:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.005408:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002246099d/0x45228d86de4d6872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.005415:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef5de3000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.005417:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002246099d/0x45228d86de4d6872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.005423:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002246099d/0x45228d86de4d6872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.005439:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002246099d/0x45228d86de4d6872 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.005445:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002246099d/0x45228d86de4d6872 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.005459:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.005460:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.005462:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.005951:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.005958:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b491dc3/0x45228d86de4d6879 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.005968:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734078.005972:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.005976:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b491dc3/0x45228d86de4d6879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.005986:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b491dc3/0x45228d86de4d6879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.005995:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b491dc3/0x45228d86de4d6879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.006014:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b491dc3/0x45228d86de4d6879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.006042:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.006063:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.006069:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b491dc3/0x45228d86de4d6879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.006076:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee832600 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.006079:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b491dc3/0x45228d86de4d6879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.006084:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b491dc3/0x45228d86de4d6879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.006093:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b491dc3/0x45228d86de4d6879 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.006098:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b491dc3/0x45228d86de4d6879 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.006118:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.006119:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.006120:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.007430:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.007439:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5f1a590/0x45228d86de4d6880 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.007452:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787734078.007455:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.007461:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5f1a590/0x45228d86de4d6880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.007471:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5f1a590/0x45228d86de4d6880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.007481:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5f1a590/0x45228d86de4d6880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.007487:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5f1a590/0x45228d86de4d6880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.007508:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.007538:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.007546:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5f1a590/0x45228d86de4d6880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.007554:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee832e00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.007559:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5f1a590/0x45228d86de4d6880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.007568:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5f1a590/0x45228d86de4d6880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.007584:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5f1a590/0x45228d86de4d6880 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.007591:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5f1a590/0x45228d86de4d6880 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.007675:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.007677:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.007679:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787734078.008480:0:15136:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1787734078.008585:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14476:x1874574705784576:12345-0@lo:5:osp-pre-1-0.0 Request processed in 44242us (50491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734078.008597:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787734078.008631:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787734078.008639:0:14476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14476:1874574705784576:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787734078.008646:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14474:x1874574705784448:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787734078.008656:0:14476:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787734078.008722:0:14476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14476:1874574705784704:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787734078.008948:0:14476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734078.009000:0:14476:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed19a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787734078.009230:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787734078.009241:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787734078.009522:0:15137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705784704 00000100:00100000:1.0:1787734078.009530:0:15137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705784704 00000100:00100000:3.0:1787734078.009887:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787734078.009897:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14476:x1874574705784704:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787734078.009936:0:15990:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00002000:00080000:2.0:1787734078.012584:0:15136:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787734078.012595:0:15136:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787734078.012601:0:15136:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:3.0:1787734078.022288:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14476:x1874574705784704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12386us (13333us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787734078.022301:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00010000:2.0:1787734078.022326:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.022336:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f613df/0x45228d86de4d6887 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.022353:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.022357:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.022364:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047f613df/0x45228d86de4d6887 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734078.022365:0:14476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14476:1874574705784704:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787734078.022385:0:14476:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787734078.022387:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047f613df/0x45228d86de4d6887 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.022401:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f613df/0x45228d86de4d6887 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.022409:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047f613df/0x45228d86de4d6887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.022438:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787734078.023418:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.023426:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dfcb0da/0x45228d86de4d688e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.023438:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.023448:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.023453:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dfcb0da/0x45228d86de4d688e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.023466:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dfcb0da/0x45228d86de4d688e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.023475:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dfcb0da/0x45228d86de4d688e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.023482:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dfcb0da/0x45228d86de4d688e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.023505:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787734078.023819:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787734078.023829:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047f613df/0x45228d86de4d6887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.023839:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee833400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.023844:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f613df/0x45228d86de4d6887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.023854:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f613df/0x45228d86de4d6887 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.023873:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047f613df/0x45228d86de4d6887 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.023881:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047f613df/0x45228d86de4d6887 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.023902:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.023905:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dfcb0da/0x45228d86de4d688e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.023911:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee832800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.023921:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dfcb0da/0x45228d86de4d688e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.023928:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dfcb0da/0x45228d86de4d688e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.023939:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dfcb0da/0x45228d86de4d688e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.023946:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dfcb0da/0x45228d86de4d688e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.023959:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.023961:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.023962:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.024506:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.024514:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000597651f2/0x45228d86de4d6895 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.024525:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.024528:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.024533:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000597651f2/0x45228d86de4d6895 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.024543:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000597651f2/0x45228d86de4d6895 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.024551:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000597651f2/0x45228d86de4d6895 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.024566:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000597651f2/0x45228d86de4d6895 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.024588:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.024832:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.024838:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000597651f2/0x45228d86de4d6895 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.024848:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee832000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.024852:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000597651f2/0x45228d86de4d6895 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.024861:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000597651f2/0x45228d86de4d6895 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.024875:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000597651f2/0x45228d86de4d6895 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.024890:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000597651f2/0x45228d86de4d6895 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.024908:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.024910:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.024913:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.025012:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.025550:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.025558:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d6fc11f/0x45228d86de4d689c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.025568:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.025571:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.025576:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d6fc11f/0x45228d86de4d689c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.025586:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d6fc11f/0x45228d86de4d689c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.025595:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d6fc11f/0x45228d86de4d689c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.025665:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d6fc11f/0x45228d86de4d689c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.025806:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.025830:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.025836:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d6fc11f/0x45228d86de4d689c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.025844:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee833c00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.025848:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d6fc11f/0x45228d86de4d689c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.025857:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d6fc11f/0x45228d86de4d689c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.025879:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d6fc11f/0x45228d86de4d689c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.025888:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d6fc11f/0x45228d86de4d689c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.025904:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.025905:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.025907:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.026982:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.026991:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ff7065/0x45228d86de4d68a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.027134:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.027138:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.027143:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001ff7065/0x45228d86de4d68a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.027176:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001ff7065/0x45228d86de4d68a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.027187:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ff7065/0x45228d86de4d68a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.027196:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001ff7065/0x45228d86de4d68a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.027223:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787734078.027280:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734078.027289:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001ff7065/0x45228d86de4d68a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.027299:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee832a00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.027304:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ff7065/0x45228d86de4d68a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.027326:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ff7065/0x45228d86de4d68a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.027346:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001ff7065/0x45228d86de4d68a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.027354:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001ff7065/0x45228d86de4d68a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.027385:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.027389:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.027393:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.028339:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.028347:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9494168/0x45228d86de4d68aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.028358:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.028361:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.028366:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9494168/0x45228d86de4d68aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.028377:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9494168/0x45228d86de4d68aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.028395:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9494168/0x45228d86de4d68aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.028402:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9494168/0x45228d86de4d68aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.028428:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787734078.028681:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734078.028689:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9494168/0x45228d86de4d68aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.028699:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee832c00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.028705:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9494168/0x45228d86de4d68aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.028715:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9494168/0x45228d86de4d68aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.028732:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9494168/0x45228d86de4d68aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.028752:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9494168/0x45228d86de4d68aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.028784:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.028787:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.028801:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.029545:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.029554:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e939c9d/0x45228d86de4d68b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.029564:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.029567:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.029572:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e939c9d/0x45228d86de4d68b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.029582:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e939c9d/0x45228d86de4d68b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.029590:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e939c9d/0x45228d86de4d68b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.029597:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e939c9d/0x45228d86de4d68b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.029805:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787734078.029829:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734078.029836:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e939c9d/0x45228d86de4d68b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.029844:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee832200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.029848:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e939c9d/0x45228d86de4d68b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.029856:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e939c9d/0x45228d86de4d68b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.029869:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e939c9d/0x45228d86de4d68b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.029875:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e939c9d/0x45228d86de4d68b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.029894:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.029896:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.029899:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.030511:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.030518:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8df2766/0x45228d86de4d68b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.030528:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.030532:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.030536:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8df2766/0x45228d86de4d68b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.030547:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8df2766/0x45228d86de4d68b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.030556:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8df2766/0x45228d86de4d68b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.030564:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8df2766/0x45228d86de4d68b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.030583:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.030606:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.030614:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8df2766/0x45228d86de4d68b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.030624:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee832400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.030628:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8df2766/0x45228d86de4d68b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.030637:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8df2766/0x45228d86de4d68b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.030651:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8df2766/0x45228d86de4d68b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.030659:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8df2766/0x45228d86de4d68b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.030675:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.030677:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.030679:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.031458:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.031466:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8794a6a/0x45228d86de4d68bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.031476:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.031484:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.031489:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8794a6a/0x45228d86de4d68bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.031498:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8794a6a/0x45228d86de4d68bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.031507:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8794a6a/0x45228d86de4d68bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.031514:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8794a6a/0x45228d86de4d68bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.031533:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.031556:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.031562:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8794a6a/0x45228d86de4d68bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.031571:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee833600 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.031575:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8794a6a/0x45228d86de4d68bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.031595:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8794a6a/0x45228d86de4d68bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.031608:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8794a6a/0x45228d86de4d68bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.031615:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8794a6a/0x45228d86de4d68bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.031636:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.031639:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.031641:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.032359:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.032366:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098f5a3e1/0x45228d86de4d68c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.032377:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.032380:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.032385:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098f5a3e1/0x45228d86de4d68c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.032395:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098f5a3e1/0x45228d86de4d68c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.032405:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098f5a3e1/0x45228d86de4d68c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.032418:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098f5a3e1/0x45228d86de4d68c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.032436:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.032459:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.032466:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098f5a3e1/0x45228d86de4d68c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.032474:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee833200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.032478:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098f5a3e1/0x45228d86de4d68c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.032487:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098f5a3e1/0x45228d86de4d68c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.032500:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098f5a3e1/0x45228d86de4d68c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.032518:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098f5a3e1/0x45228d86de4d68c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.032538:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.032541:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.032543:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.033271:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.033279:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048234b66/0x45228d86de4d68cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.033288:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.033291:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.033295:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048234b66/0x45228d86de4d68cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.033305:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048234b66/0x45228d86de4d68cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.033313:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048234b66/0x45228d86de4d68cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.033321:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048234b66/0x45228d86de4d68cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.033338:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.033363:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.033370:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048234b66/0x45228d86de4d68cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.033379:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee833800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.033382:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048234b66/0x45228d86de4d68cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.033390:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048234b66/0x45228d86de4d68cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.033403:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048234b66/0x45228d86de4d68cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.033409:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048234b66/0x45228d86de4d68cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.033426:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.033429:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.033431:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.033895:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.033967:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac2c2695/0x45228d86de4d68d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.033985:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.033988:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.033992:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2c2695/0x45228d86de4d68d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.034116:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac2c2695/0x45228d86de4d68d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.034126:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac2c2695/0x45228d86de4d68d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.034133:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2c2695/0x45228d86de4d68d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.034173:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.034304:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.034311:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac2c2695/0x45228d86de4d68d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.034319:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee833000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.034324:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2c2695/0x45228d86de4d68d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.034333:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2c2695/0x45228d86de4d68d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.034355:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac2c2695/0x45228d86de4d68d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.034362:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac2c2695/0x45228d86de4d68d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.034380:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.034382:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.034384:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.034617:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.034623:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7643cea/0x45228d86de4d68db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.034632:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.034635:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.034640:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7643cea/0x45228d86de4d68db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.034649:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7643cea/0x45228d86de4d68db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.034778:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7643cea/0x45228d86de4d68db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.034789:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7643cea/0x45228d86de4d68db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.034964:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787734078.035122:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.035128:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7643cea/0x45228d86de4d68db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.035136:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee833a00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.035140:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7643cea/0x45228d86de4d68db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.035176:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7643cea/0x45228d86de4d68db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.035189:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7643cea/0x45228d86de4d68db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.035197:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7643cea/0x45228d86de4d68db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.035211:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.035212:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.035214:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.035660:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.035666:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d57c49/0x45228d86de4d68e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.035806:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.035809:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.035813:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d57c49/0x45228d86de4d68e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.035889:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d57c49/0x45228d86de4d68e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.035897:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d57c49/0x45228d86de4d68e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.035972:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d57c49/0x45228d86de4d68e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.036120:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787734078.036545:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.036552:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42250a0/0x45228d86de4d68e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.036561:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.036564:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.036568:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42250a0/0x45228d86de4d68e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.036578:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42250a0/0x45228d86de4d68e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.036585:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42250a0/0x45228d86de4d68e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.036593:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f42250a0/0x45228d86de4d68e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.036612:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787734078.036767:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787734078.036775:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7d57c49/0x45228d86de4d68e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.036785:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891eee833e00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.036790:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d57c49/0x45228d86de4d68e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.036810:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d57c49/0x45228d86de4d68e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.036823:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7d57c49/0x45228d86de4d68e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.036830:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d57c49/0x45228d86de4d68e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.036845:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734078.036848:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f42250a0/0x45228d86de4d68e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.036854:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729b400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.036856:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42250a0/0x45228d86de4d68e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.036862:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42250a0/0x45228d86de4d68e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.036897:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f42250a0/0x45228d86de4d68e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.036905:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42250a0/0x45228d86de4d68e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.036919:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.036928:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.037523:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.037531:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e289d1a/0x45228d86de4d68f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.037540:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.037549:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.037553:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e289d1a/0x45228d86de4d68f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.037563:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e289d1a/0x45228d86de4d68f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.037571:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e289d1a/0x45228d86de4d68f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.037577:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e289d1a/0x45228d86de4d68f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.037627:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787734078.037757:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734078.037762:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e289d1a/0x45228d86de4d68f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.037770:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729a800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.037774:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e289d1a/0x45228d86de4d68f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.037782:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e289d1a/0x45228d86de4d68f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.037809:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e289d1a/0x45228d86de4d68f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.037817:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e289d1a/0x45228d86de4d68f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.037835:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.037843:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.038129:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.038135:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb9828f0/0x45228d86de4d68f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.038143:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.038146:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.038150:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb9828f0/0x45228d86de4d68f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.038189:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb9828f0/0x45228d86de4d68f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.038198:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb9828f0/0x45228d86de4d68f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.038211:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb9828f0/0x45228d86de4d68f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.038681:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.038689:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb9828f0/0x45228d86de4d68f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.038697:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729a000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.038701:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb9828f0/0x45228d86de4d68f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.038709:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb9828f0/0x45228d86de4d68f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.038722:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb9828f0/0x45228d86de4d68f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.038738:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.038739:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787734078.038741:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734078.039400:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787734078.039408:0:15136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb9828f0/0x45228d86de4d68f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.039522:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.039980:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.039987:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb68e408/0x45228d86de4d68fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.040009:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.040013:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.040020:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb68e408/0x45228d86de4d68fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.040031:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb68e408/0x45228d86de4d68fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.040040:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb68e408/0x45228d86de4d68fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.040048:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb68e408/0x45228d86de4d68fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.040431:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787734078.040439:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb68e408/0x45228d86de4d68fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.040447:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729bc00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734078.040451:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb68e408/0x45228d86de4d68fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.040460:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb68e408/0x45228d86de4d68fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734078.040476:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb68e408/0x45228d86de4d68fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.040516:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734078.040518:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734078.040520:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734078.040552:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787734078.040558:0:15136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb68e408/0x45228d86de4d68fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.040561:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.041411:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.041418:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000080aae16/0x45228d86de4d6905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.041428:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.041431:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.041437:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000080aae16/0x45228d86de4d6905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.041447:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000080aae16/0x45228d86de4d6905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.041456:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000080aae16/0x45228d86de4d6905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.041464:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000080aae16/0x45228d86de4d6905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.041480:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734078.041497:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734078.041503:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000080aae16/0x45228d86de4d6905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.041510:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729aa00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734078.041513:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000080aae16/0x45228d86de4d6905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.041519:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000080aae16/0x45228d86de4d6905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.041532:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000080aae16/0x45228d86de4d6905 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.041537:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000080aae16/0x45228d86de4d6905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.041561:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734078.041562:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734078.041565:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.042334:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.042340:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020e3515a/0x45228d86de4d690c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.042355:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.042358:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.042362:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020e3515a/0x45228d86de4d690c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.042372:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020e3515a/0x45228d86de4d690c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.042381:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020e3515a/0x45228d86de4d690c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.042388:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020e3515a/0x45228d86de4d690c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.042407:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787734078.042431:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734078.042439:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020e3515a/0x45228d86de4d690c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.042449:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729ac00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.042453:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020e3515a/0x45228d86de4d690c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.042462:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020e3515a/0x45228d86de4d690c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.042478:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020e3515a/0x45228d86de4d690c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.042485:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020e3515a/0x45228d86de4d690c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.042504:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.042507:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.042509:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.043284:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.043291:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e17338c/0x45228d86de4d6913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.043301:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.043304:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.043308:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e17338c/0x45228d86de4d6913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.043316:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e17338c/0x45228d86de4d6913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.043335:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e17338c/0x45228d86de4d6913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.043342:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e17338c/0x45228d86de4d6913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.043366:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734078.043420:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734078.043426:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e17338c/0x45228d86de4d6913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.043436:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729a200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734078.043440:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e17338c/0x45228d86de4d6913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.043448:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e17338c/0x45228d86de4d6913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.043462:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e17338c/0x45228d86de4d6913 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.043468:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e17338c/0x45228d86de4d6913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.043486:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734078.043488:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734078.043490:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.044288:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.044295:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005515e963/0x45228d86de4d691a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.044305:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.044309:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.044314:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005515e963/0x45228d86de4d691a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.044323:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005515e963/0x45228d86de4d691a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.044332:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005515e963/0x45228d86de4d691a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.044339:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005515e963/0x45228d86de4d691a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.044369:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787734078.044393:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734078.044401:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005515e963/0x45228d86de4d691a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.044411:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729a400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.044422:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005515e963/0x45228d86de4d691a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.044438:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005515e963/0x45228d86de4d691a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.044452:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005515e963/0x45228d86de4d691a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.044458:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005515e963/0x45228d86de4d691a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.044476:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.044480:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.044483:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.045268:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.045277:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac911dc3/0x45228d86de4d6921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.045289:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.045292:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.045297:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac911dc3/0x45228d86de4d6921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.045308:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac911dc3/0x45228d86de4d6921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.045317:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac911dc3/0x45228d86de4d6921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.045326:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac911dc3/0x45228d86de4d6921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.045348:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734078.045375:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734078.045383:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac911dc3/0x45228d86de4d6921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.045405:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729b600 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734078.045410:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac911dc3/0x45228d86de4d6921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.045420:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac911dc3/0x45228d86de4d6921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.045435:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac911dc3/0x45228d86de4d6921 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.045442:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac911dc3/0x45228d86de4d6921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.045462:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734078.045464:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734078.045467:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.046250:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.046257:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091d408ab/0x45228d86de4d6928 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.046267:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.046275:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.046280:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091d408ab/0x45228d86de4d6928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.046290:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091d408ab/0x45228d86de4d6928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.046299:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091d408ab/0x45228d86de4d6928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.046306:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091d408ab/0x45228d86de4d6928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.046330:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787734078.046809:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734078.046878:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091d408ab/0x45228d86de4d6928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.046887:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729b200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.046891:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091d408ab/0x45228d86de4d6928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.046899:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091d408ab/0x45228d86de4d6928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.046974:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091d408ab/0x45228d86de4d6928 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.046989:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091d408ab/0x45228d86de4d6928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.047123:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.047126:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.047128:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.047292:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.047299:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a993a51/0x45228d86de4d692f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.047307:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.047311:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.047315:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a993a51/0x45228d86de4d692f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.047326:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a993a51/0x45228d86de4d692f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.047333:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a993a51/0x45228d86de4d692f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.047346:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a993a51/0x45228d86de4d692f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.047367:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787734078.047423:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787734078.047431:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a993a51/0x45228d86de4d692f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.047439:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729b800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734078.047442:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a993a51/0x45228d86de4d692f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.047451:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a993a51/0x45228d86de4d692f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.047471:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a993a51/0x45228d86de4d692f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.047479:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a993a51/0x45228d86de4d692f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734078.047495:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734078.047498:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787734078.047501:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787734078.048293:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.048301:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f43e35f8/0x45228d86de4d6936 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.048310:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.048314:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.048319:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f43e35f8/0x45228d86de4d6936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.048329:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f43e35f8/0x45228d86de4d6936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.048338:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f43e35f8/0x45228d86de4d6936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.048345:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f43e35f8/0x45228d86de4d6936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.048403:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787734078.048859:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787734078.048865:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4fc009a/0x45228d86de4d693d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.048879:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787734078.048882:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734078.048886:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4fc009a/0x45228d86de4d693d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.048896:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4fc009a/0x45228d86de4d693d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.048917:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4fc009a/0x45228d86de4d693d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734078.048925:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4fc009a/0x45228d86de4d693d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.049357:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787734078.049364:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f43e35f8/0x45228d86de4d6936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.049372:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729b000 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.049377:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f43e35f8/0x45228d86de4d6936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.049386:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f43e35f8/0x45228d86de4d6936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.049398:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f43e35f8/0x45228d86de4d6936 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.049406:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f43e35f8/0x45228d86de4d6936 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.049422:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734078.049425:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4fc009a/0x45228d86de4d693d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.049438:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729ba00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734078.049441:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4fc009a/0x45228d86de4d693d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.049448:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4fc009a/0x45228d86de4d693d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.049457:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4fc009a/0x45228d86de4d693d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734078.049464:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.049466:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734078.049468:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734078.049512:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787734078.049518:0:15136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4fc009a/0x45228d86de4d693d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787734078.049883:0:15136:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:0.0:1787734078.049913:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787734078.050149:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14474:x1874574705784448:12345-0@lo:5:osp-pre-0-0.0 Request processed in 41504us (92119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734078.050210:0:14474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14474:1874574705784448:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787734078.050225:0:14474:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787734078.050280:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787734078.050380:0:14474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60ca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14474:1874574705784832:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787734078.050415:0:14474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734078.050457:0:15137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705784832 00000100:00100000:0.0:1787734078.050459:0:14474:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9000 going to sleep for 11 seconds 00000100:00100000:1.0:1787734078.050466:0:15137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705784832 00000100:00100000:1.0:1787734078.050513:0:15137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787734078.050523:0:15137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14474:x1874574705784832:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787734078.050557:0:15137:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1787734078.061714:0:15137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14474:x1874574705784832:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11188us (11294us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787734078.061724:0:15137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787734078.061782:0:14474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60ca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14474:1874574705784832:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787734078.061810:0:14474:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787734078.714289:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734079.743250:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787734079.887376:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787734079.887435:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787734080.762934:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787734081.423447:0:16205:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00100000:0.0:1787734081.475471:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787734081.475486:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1787734081.786415:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734082.813408:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787734083.256696:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734083.256814:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690064896 00000100:00100000:1.0:1787734083.256824:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690064896 00000100:00100000:1.0:1787734083.256904:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:1.0:1787734083.256913:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1874574690064896:12345-192.168.201.34@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787734083.256941:0:14444:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9dee5c0f-8c74-494c-994c-130f4d2be35b@192.168.201.34@tcp t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:1.0:1787734083.256978:0:14444:0:(genops.c:1385:class_connect()) connect: client 9dee5c0f-8c74-494c-994c-130f4d2be35b, cookie 0x45228d86de4d6944 00000100:00080000:1.0:1787734083.257111:0:14444:0:(import.c:65:import_set_state_nolock()) ffff891ef6c8c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787734083.257220:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+5:2353:x1874574690064896:12345-192.168.201.34@tcp:250:mount.lustre.0 Request processed in 307us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734083.257228:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:0.0:1787734083.265372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734083.265491:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690065024 00000100:00100000:3.0:1787734083.265501:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690065024 00000100:00100000:3.0:1787734083.265573:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:3.0:1787734083.265593:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+5:13744:x1874574690065024:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787734083.265609:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734083.265626:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0030400/0x45228d86de4d694b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df197ca expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734083.265655:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0030400/0x45228d86de4d694b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197ca expref: 6 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734083.265683:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0030400/0x45228d86de4d694b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197ca expref: 6 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734083.265692:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030400, rc 0) 00000100:00100000:3.0:1787734083.265763:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+6:13744:x1874574690065024:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 173us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734083.265770:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:0.0:1787734083.271731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734083.272026:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690065152 00000100:00100000:1.0:1787734083.272035:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690065152 00000100:00100000:1.0:1787734083.272090:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:1.0:1787734083.272100:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+6:13744:x1874574690065152:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787734083.272545:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+6:13744:x1874574690065152:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 445us (822us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787734083.272554:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:0.0:1787734083.275106:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734083.275278:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690065280 00000100:00100000:2.0:1787734083.275298:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690065280 00000100:00100000:2.0:1787734083.275352:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:2.0:1787734083.275362:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efeabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+6:13744:x1874574690065280:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787734083.275378:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734083.275396:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891dc729aa00/0x45228d86de4d6952 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df197d1 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734083.275427:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891dc729aa00/0x45228d86de4d6952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197d1 expref: 7 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734083.275438:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891dc729aa00/0x45228d86de4d6952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197d1 expref: 7 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734083.275447:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891dc729aa00, rc 0) 00000100:00100000:2.0:1787734083.275502:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efeabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+7:13744:x1874574690065280:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 140us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.275509:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:0.0:1787734083.277442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734083.277496:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690065408 00000100:00100000:1.0:1787734083.277505:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690065408 00000100:00100000:1.0:1787734083.277561:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:1.0:1787734083.277570:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+7:13744:x1874574690065408:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787734083.277946:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+8:13744:x1874574690065408:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 376us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734083.277954:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:0.0:1787734083.279584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734083.279665:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690065536 00000100:00100000:2.0:1787734083.279673:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690065536 00000100:00100000:2.0:1787734083.279733:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:2.0:1787734083.279742:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+8:13744:x1874574690065536:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787734083.280197:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+8:13744:x1874574690065536:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 454us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.280214:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:0.0:1787734083.283352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734083.285625:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690065664 00000100:00100000:2.0:1787734083.285640:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690065664 00000100:00100000:2.0:1787734083.285717:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:2.0:1787734083.285728:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+8:13762:x1874574690065664:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787734083.286077:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+8:13762:x1874574690065664:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 350us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.286085:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:0.0:1787734083.293230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734083.293369:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690065792 00000100:00100000:2.0:1787734083.293379:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690065792 00000100:00100000:2.0:1787734083.293439:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:2.0:1787734083.293451:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+8:13762:x1874574690065792:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787734083.293775:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+8:13762:x1874574690065792:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 325us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.293783:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:0.0:1787734083.297054:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734083.297297:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690065920 00000100:00100000:3.0:1787734083.297308:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690065920 00000100:00100000:3.0:1787734083.297365:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:3.0:1787734083.297381:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+8:13744:x1874574690065920:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787734083.297397:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734083.297419:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0031600/0x45228d86de4d6959 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df197fb expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734083.297450:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0031600/0x45228d86de4d6959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197fb expref: 9 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734083.297461:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0031600/0x45228d86de4d6959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df197fb expref: 9 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734083.297470:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031600, rc 0) 00000100:00100000:3.0:1787734083.297682:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+9:13744:x1874574690065920:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 307us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734083.297690:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:3.0:1787734083.306362:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734083.307877:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690066048 00000100:00100000:1.0:1787734083.307890:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690066048 00000100:00100000:1.0:1787734083.307991:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:1.0:1787734083.308001:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+9:13744:x1874574690066048:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787734083.308027:0:14444:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787734083.308048:0:14444:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787734083.308052:0:14444:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787734083.308055:0:14444:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787734083.308058:0:14444:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787734083.309471:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+9:13744:x1874574690066048:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 1465us (3111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734083.309482:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:0.0:1787734083.311138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734083.311448:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690066176 00000100:00100000:3.0:1787734083.311457:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690066176 00000100:00100000:3.0:1787734083.311545:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:3.0:1787734083.311555:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+9:13744:x1874574690066176:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787734083.311570:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734083.311586:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0031400/0x45228d86de4d6960 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df19802 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734083.311612:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0031400/0x45228d86de4d6960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19802 expref: 10 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734083.311620:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0031400/0x45228d86de4d6960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19802 expref: 10 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734083.311627:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031400, rc 0) 00000100:00100000:3.0:1787734083.311694:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+10:13744:x1874574690066176:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 142us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734083.311709:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:2.0:1787734083.313561:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734083.313662:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690066304 00000100:00100000:1.0:1787734083.313670:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690066304 00000100:00100000:1.0:1787734083.313752:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:1.0:1787734083.313761:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+10:13744:x1874574690066304:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787734083.314022:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+10:13744:x1874574690066304:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 262us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734083.314030:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:0.0:1787734083.318103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734083.318425:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690066432 00000100:00100000:3.0:1787734083.318436:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690066432 00000100:00100000:3.0:1787734083.318623:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:3.0:1787734083.318634:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+10:13744:x1874574690066432:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787734083.321833:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+10:13744:x1874574690066432:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 3189us (3728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.321849:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:0.0:1787734083.327416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734083.327867:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690066560 00000100:00100000:1.0:1787734083.327877:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690066560 00000100:00100000:1.0:1787734083.327939:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:1.0:1787734083.327949:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+10:13766:x1874574690066560:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787734083.328278:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+10:13766:x1874574690066560:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 329us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734083.328286:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:1.0:1787734083.335818:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734083.335925:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690066688 00000100:00100000:2.0:1787734083.335936:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690066688 00000100:00100000:2.0:1787734083.335997:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:2.0:1787734083.336008:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+10:13766:x1874574690066688:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787734083.336355:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+10:13766:x1874574690066688:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 347us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.336374:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:0.0:1787734083.341280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734083.342205:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690066816 00000100:00100000:2.0:1787734083.342219:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690066816 00000100:00100000:2.0:1787734083.342276:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:2.0:1787734083.342285:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1874574690066816:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787734083.342328:0:14451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf@192.168.201.34@tcp t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:2.0:1787734083.342379:0:14451:0:(genops.c:1385:class_connect()) connect: client b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf, cookie 0x45228d86de4d6967 00000004:00100000:2.0:1787734083.342408:0:14451:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787734083.342415:0:14451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787734083.360295:0:14451:0:(import.c:65:import_set_state_nolock()) ffff891ef0328800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787734083.360423:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:2353:x1874574690066816:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 18135us (19150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.360434:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1787734083.369289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734083.369345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734083.369423:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690067072 00000100:00100000:3.0:1787734083.369434:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690067072 00000100:00100000:3.0:1787734083.369513:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690066944 00000100:00100000:3.0:1787734083.369516:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690066944 00000100:00100000:3.0:1787734083.369534:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1787734083.369544:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:13744:x1874574690067072:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787734083.369622:0:14452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787734083.369726:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:13744:x1874574690067072:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 182us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734083.369734:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1787734083.369759:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1787734083.369766:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:0:x1874574690066944:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787734083.369778:0:14452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787734083.369802:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:0:x1874574690066944:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 36us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734083.369808:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00080000:0.0:1787734083.369869:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787734083.372470:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734083.372740:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690067200 00000100:00100000:3.0:1787734083.372750:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690067200 00000100:00100000:3.0:1787734083.372850:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787734083.372863:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:13744:x1874574690067200:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787734083.372963:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:13744:x1874574690067200:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 102us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734083.372971:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1787734083.374651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734083.374806:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690067328 00000100:00100000:1.0:1787734083.374814:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690067328 00000100:00100000:1.0:1787734083.374855:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1787734083.374863:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1874574690067328:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787734083.374893:0:15990:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf@192.168.201.34@tcp t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:1.0:1787734083.374926:0:15990:0:(genops.c:1385:class_connect()) connect: client b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf, cookie 0x45228d86de4d696e 00002000:00100000:1.0:1787734083.374937:0:15990:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf/ffff891ef6c8a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787734083.374961:0:15990:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787734083.375316:0:15990:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787734083.375347:0:15990:0:(import.c:65:import_set_state_nolock()) ffff891ef6c8f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787734083.375412:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:2353:x1874574690067328:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 549us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734083.375419:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:0.0:1787734083.376301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734083.376345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734083.376426:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690067584 00000100:00100000:3.0:1787734083.376434:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690067584 00000100:00100000:3.0:1787734083.376472:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1787734083.376481:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:13744:x1874574690067584:12345-192.168.201.34@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787734083.376971:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690067456 00000100:00100000:2.0:1787734083.376976:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690067456 00000100:00100000:2.0:1787734083.377008:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1787734083.377014:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1874574690067456:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787734083.377038:0:15138:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf@192.168.201.34@tcp t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:2.0:1787734083.377066:0:15138:0:(genops.c:1385:class_connect()) connect: client b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf, cookie 0x45228d86de4d6975 00002000:00100000:2.0:1787734083.377077:0:15138:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf/ffff891ef032a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787734083.377100:0:15138:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787734083.377429:0:15138:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787734083.377457:0:15138:0:(import.c:65:import_set_state_nolock()) ffff891ef032f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787734083.377505:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:2353:x1874574690067456:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 489us (1205us total) trans 0 rc 0/0 00000004:00080000:3.0:1787734083.378084:0:14454:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1534us 00000100:00100000:2.0:1787734083.378802:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1787734083.386326:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705784960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787734083.386390:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734083.386463:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705784960 00000100:00100000:0.0:1787734083.386470:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705784960 00000100:00100000:0.0:1787734083.386536:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787734083.386544:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705784960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787734083.386564:0:15139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787734083.386852:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705785088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787734083.386886:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734083.387098:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705784960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 553us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734083.387107:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787734083.387133:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705785088 00000100:00100000:0.0:1787734083.387137:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705785088 00000100:00100000:0.0:1787734083.387186:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787734083.387192:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705785088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787734083.387205:0:15139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787734083.387236:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705785088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734083.387256:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787734083.387279:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787734083.387282:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787734083.387304:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787734083.387324:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705785088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787734083.388786:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787734083.388811:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705784960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787734083.389347:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787734083.389449:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705785344:0@lo:400:kworker.0 00000100:00100000:2.0:1787734083.389504:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734083.389544:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787734083.389549:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705785472:0@lo:400:kworker.0 00000100:00100000:2.0:1787734083.389581:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734083.389612:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705785344 00000100:00100000:2.0:1787734083.389618:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705785344 00000100:00100000:2.0:1787734083.389653:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705785472 00000100:00100000:2.0:1787734083.389655:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705785472 00000100:00100000:2.0:1787734083.389679:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787734083.389686:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705785344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734083.389740:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705785344:12345-0@lo:400:kworker.0 Request processed in 54us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.389746:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787734083.389762:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787734083.389768:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705785472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734083.389793:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874574705785472:12345-0@lo:400:kworker.0 Request processed in 26us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.389799:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787734083.389833:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff2f800 x1874574705785472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787734083.389845:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874574705785472:0@lo:400:kworker.0 00010000:00080000:2.0:1787734083.389856:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff2d180 x1874574705785344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787734083.389879:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705785344:0@lo:400:kworker.0 00000100:00080000:0.0:1787734083.390326:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787734083.391938:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705785600:0@lo:400:kworker.0 00000100:00100000:3.0:1787734083.391999:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734083.392036:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705785216:0@lo:400:kworker.0 00000100:00100000:3.0:1787734083.392064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734083.392147:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705785600 00000100:00100000:2.0:1787734083.392177:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705785600 00000100:00100000:2.0:1787734083.392236:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787734083.392245:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705785600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734083.392296:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705785600:12345-0@lo:400:kworker.0 Request processed in 52us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.392303:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787734083.392343:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891eeff2ea00 x1874574705785600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787734099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787734083.392358:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705785600:0@lo:400:kworker.0 00000100:00080000:3.0:1787734083.392473:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787734083.396667:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705785216 00000100:00100000:1.0:1787734083.396681:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705785216 00000100:00100000:1.0:1787734083.396741:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787734083.396750:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:3312:x1874574705785216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734083.396832:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:3312:x1874574705785216:12345-0@lo:400:kworker.0 Request processed in 84us (4767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734083.396839:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787734083.396886:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705785216:0@lo:400:kworker.0 00000004:00200000:3.0:1787734083.398359:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787734083.398770:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:13744:x1874574690067584:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 22285us (22420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.398785:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787734083.553808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734083.557279:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690067712 00000100:00100000:2.0:1787734083.557296:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690067712 00000100:00100000:2.0:1787734083.557380:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1787734083.557392:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:13787:x1874574690067712:12345-192.168.201.34@tcp:101:mkdir.0 00010000:00010000:2.0:1787734083.557415:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734083.557446:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b200/0x45228d86de4d697c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1982c expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734083.558705:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a400/0x45228d86de4d6983 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734083.558742:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a400/0x45228d86de4d6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734083.558759:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a400/0x45228d86de4d6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787734083.559409:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787734083.559417:0:14453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787734083.560747:0:14453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a400/0x45228d86de4d6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734083.560801:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b200/0x45228d86de4d697c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1982c expref: 8 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734083.561783:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a400/0x45228d86de4d6983 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1982c expref: 7 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734083.561797:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0fd5e00) 00010000:00010000:2.0:1787734083.561800:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787734083.561804:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891dc729a400, rc 0) 00000100:00100000:2.0:1787734083.561901:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:13787:x1874574690067712:12345-192.168.201.34@tcp:101:mkdir.0 Request processed in 4510us (8103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734083.561911:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00010000:00010000:2.0:1787734083.835770:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787734084.347514:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787734084.858341:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787734084.984756:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf 00000100:00100000:2.0:1787734085.491733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734085.491830:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690067840 00000100:00100000:1.0:1787734085.491840:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690067840 00000100:00100000:1.0:1787734085.491912:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1787734085.491924:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:13839:x1874574690067840:12345-192.168.201.34@tcp:41:lfs.0 00000004:00000024:1.0:1787734085.491970:0:14451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787734085.492067:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:13839:x1874574690067840:12345-192.168.201.34@tcp:41:lfs.0 Request processed in 146us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734085.492075:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00080000:3.0:1787734085.492143:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787734085.497789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734085.497901:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690067968 00000100:00100000:1.0:1787734085.497911:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690067968 00000100:00100000:1.0:1787734085.498008:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1787734085.498019:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:13839:x1874574690067968:12345-192.168.201.34@tcp:13:lfs.0 00002000:00000024:1.0:1787734085.498057:0:15139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787734085.498146:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:13839:x1874574690067968:12345-192.168.201.34@tcp:13:lfs.0 Request processed in 128us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734085.498180:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00080000:3.0:1787734085.498643:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787734085.502994:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734085.503212:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690068096 00000100:00100000:1.0:1787734085.503223:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690068096 00000100:00080000:3.0:1787734085.503484:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787734085.503528:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1787734085.503540:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:13839:x1874574690068096:12345-192.168.201.34@tcp:13:lfs.0 00002000:00000024:0.0:1787734085.503579:0:15139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787734085.503674:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:13839:x1874574690068096:12345-192.168.201.34@tcp:13:lfs.0 Request processed in 136us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734085.503681:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:2.0:1787734085.607354:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734085.607457:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690068224 00000100:00100000:1.0:1787734085.607468:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690068224 00000100:00100000:1.0:1787734085.607541:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:1.0:1787734085.607552:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+10:13866:x1874574690068224:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787734085.607572:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787734085.607593:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cc000/0x45228d86de4d698a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df19833 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734085.607645:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cc000/0x45228d86de4d698a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19833 expref: 11 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734085.607656:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cc000/0x45228d86de4d698a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19833 expref: 11 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734085.607811:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc000, rc 0) 00000100:00100000:1.0:1787734085.607983:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13866:x1874574690068224:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 431us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734085.607991:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:1.0:1787734085.611735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734085.612712:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690068352 00000100:00100000:2.0:1787734085.612740:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690068352 00000100:00100000:2.0:1787734085.612808:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:2.0:1787734085.612820:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13866:x1874574690068352:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787734085.613418:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13866:x1874574690068352:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 598us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.613427:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:0.0:1787734085.619756:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734085.619948:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690068480 00000100:00100000:2.0:1787734085.619959:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690068480 00000100:00100000:2.0:1787734085.620029:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:2.0:1787734085.620039:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13866:x1874574690068480:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787734085.620373:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13866:x1874574690068480:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 335us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.620383:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:3.0:1787734085.628206:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734085.628320:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690068608 00000100:00100000:1.0:1787734085.628332:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690068608 00000100:00100000:1.0:1787734085.628387:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:1.0:1787734085.628398:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefb70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13875:x1874574690068608:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787734085.628748:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefb70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13875:x1874574690068608:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 350us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734085.628758:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:0.0:1787734085.662054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734085.662576:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690068736 00000100:00100000:1.0:1787734085.662586:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690068736 00000100:00100000:1.0:1787734085.662646:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:1.0:1787734085.662656:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13875:x1874574690068736:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787734085.662939:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13875:x1874574690068736:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 284us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734085.662946:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:0.0:1787734085.670989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734085.671219:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690068864 00000100:00100000:2.0:1787734085.671229:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690068864 00000100:00100000:2.0:1787734085.671293:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:2.0:1787734085.671304:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13866:x1874574690068864:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787734085.671321:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734085.671340:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891dc729a800/0x45228d86de4d6991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df1985d expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734085.671368:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891dc729a800/0x45228d86de4d6991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1985d expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734085.671379:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891dc729a800/0x45228d86de4d6991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1985d expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734085.671406:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891dc729a800, rc 0) 00000100:00100000:2.0:1787734085.671468:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+12:13866:x1874574690068864:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 164us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.671476:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:3.0:1787734085.679516:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734085.679713:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690068992 00000100:00100000:2.0:1787734085.679724:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690068992 00000100:00100000:2.0:1787734085.679785:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:2.0:1787734085.679795:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+12:13866:x1874574690068992:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787734085.679821:0:14445:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787734085.679844:0:14445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787734085.679848:0:14445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787734085.679852:0:14445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787734085.679854:0:14445:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787734085.681287:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+12:13866:x1874574690068992:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 1478us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.681298:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:0.0:1787734085.684412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734085.684566:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690069120 00000100:00100000:1.0:1787734085.684577:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690069120 00000100:00100000:1.0:1787734085.684636:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:1.0:1787734085.684648:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+12:13866:x1874574690069120:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787734085.684675:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787734085.684695:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cc400/0x45228d86de4d6998 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df19864 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734085.684725:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cc400/0x45228d86de4d6998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19864 expref: 13 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734085.684736:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cc400/0x45228d86de4d6998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19864 expref: 13 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734085.684745:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc400, rc 0) 00000100:00100000:1.0:1787734085.684815:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13866:x1874574690069120:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 169us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734085.684822:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:3.0:1787734085.686984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734085.687075:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690069248 00000100:00100000:2.0:1787734085.687146:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690069248 00000100:00100000:2.0:1787734085.687231:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:2.0:1787734085.687242:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13866:x1874574690069248:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787734085.687599:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13866:x1874574690069248:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 358us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.687607:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:0.0:1787734085.689752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734085.689836:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690069376 00000100:00100000:2.0:1787734085.689845:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690069376 00000100:00100000:2.0:1787734085.689947:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:2.0:1787734085.689957:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13866:x1874574690069376:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787734085.690252:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13866:x1874574690069376:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 296us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.690260:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:0.0:1787734085.695564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734085.695867:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690069504 00000100:00100000:1.0:1787734085.695877:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690069504 00000100:00100000:1.0:1787734085.695935:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:1.0:1787734085.695947:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13880:x1874574690069504:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787734085.696258:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13880:x1874574690069504:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 312us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734085.696266:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:3.0:1787734085.698826:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734085.698916:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690069632 00000100:00100000:2.0:1787734085.698925:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690069632 00000100:00100000:2.0:1787734085.698979:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:2.0:1787734085.698988:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13880:x1874574690069632:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787734085.699266:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13880:x1874574690069632:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 278us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.699275:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:0.0:1787734085.707081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734085.707571:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690069760 00000100:00100000:2.0:1787734085.707582:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690069760 00000100:00100000:2.0:1787734085.707635:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1787734085.707644:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1874574690069760:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787734085.707683:0:14453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5cc34a2c-4c56-448f-b60c-fc108953c500@192.168.201.34@tcp t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:2.0:1787734085.707726:0:14453:0:(genops.c:1385:class_connect()) connect: client 5cc34a2c-4c56-448f-b60c-fc108953c500, cookie 0x45228d86de4d699f 00000004:00100000:2.0:1787734085.707756:0:14453:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787734085.707877:0:14453:0:(import.c:65:import_set_state_nolock()) ffff891efe87a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787734085.708581:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2353:x1874574690069760:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 933us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.708591:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1787734085.726101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734085.726148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734085.726304:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690070016 00000100:00100000:1.0:1787734085.726315:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690070016 00000100:00100000:1.0:1787734085.726402:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690069888 00000100:00100000:1.0:1787734085.726406:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690069888 00000100:00100000:1.0:1787734085.726424:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1787734085.726435:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+7:13866:x1874574690070016:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787734085.726466:0:14451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787734085.726545:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+7:13866:x1874574690070016:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 111us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734085.726552:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1787734085.726570:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1787734085.726577:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+6:0:x1874574690069888:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787734085.726589:0:14451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787734085.726612:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+6:0:x1874574690069888:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 35us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734085.726619:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00080000:3.0:1787734085.726777:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787734085.734958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734085.735204:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690070144 00000100:00100000:1.0:1787734085.735217:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690070144 00000100:00100000:1.0:1787734085.735273:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1787734085.735283:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+6:13866:x1874574690070144:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787734085.735364:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+6:13866:x1874574690070144:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 83us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734085.735372:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1787734085.742566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734085.742611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734085.742644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734085.742798:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690070272 00000100:00100000:2.0:1787734085.742815:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690070272 00000100:00100000:2.0:1787734085.742863:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1787734085.742872:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874574690070272:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787734085.742907:0:15136:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5cc34a2c-4c56-448f-b60c-fc108953c500@192.168.201.34@tcp t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:2.0:1787734085.742937:0:15136:0:(genops.c:1385:class_connect()) connect: client 5cc34a2c-4c56-448f-b60c-fc108953c500, cookie 0x45228d86de4d69a6 00002000:00100000:2.0:1787734085.742950:0:15136:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5cc34a2c-4c56-448f-b60c-fc108953c500/ffff891efe87b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787734085.742962:0:15136:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787734085.743262:0:15136:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787734085.743291:0:15136:0:(import.c:65:import_set_state_nolock()) ffff891efe87c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787734085.743360:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2353:x1874574690070272:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 488us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.743367:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:3.0:1787734085.743813:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690070528 00000100:00100000:3.0:1787734085.743819:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690070528 00000100:00100000:3.0:1787734085.743859:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1787734085.743867:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+6:13866:x1874574690070528:12345-192.168.201.34@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787734085.744124:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787734085.744272:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+6:13866:x1874574690070528:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 406us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734085.744280:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1787734085.745717:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690070400 00000100:00100000:3.0:1787734085.745726:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690070400 00000100:00100000:3.0:1787734085.745783:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1787734085.745791:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1874574690070400:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787734085.745820:0:15138:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5cc34a2c-4c56-448f-b60c-fc108953c500@192.168.201.34@tcp t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:3.0:1787734085.745849:0:15138:0:(genops.c:1385:class_connect()) connect: client 5cc34a2c-4c56-448f-b60c-fc108953c500, cookie 0x45228d86de4d69ad 00002000:00100000:3.0:1787734085.745860:0:15138:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5cc34a2c-4c56-448f-b60c-fc108953c500/ffff891ec6c80800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787734085.745870:0:15138:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787734085.745965:0:15138:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787734085.745990:0:15138:0:(import.c:65:import_set_state_nolock()) ffff891ec6c84800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787734085.746043:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2353:x1874574690070400:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 251us (3399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734085.746051:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1787734085.748241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734085.748287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734085.748322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734085.748438:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690071040 00000100:00100000:3.0:1787734085.748446:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690071040 00000100:00100000:3.0:1787734085.748498:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1787734085.748507:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:2356:x1874574690071040:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787734085.748562:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:2356:x1874574690071040:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 56us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734085.748570:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1787734085.748635:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690070656 00000100:00100000:2.0:1787734085.748640:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690070656 00000100:00100000:2.0:1787734085.748684:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:2.0:1787734085.748691:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:2357:x1874574690070656:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787734085.748717:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:2357:x1874574690070656:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.748723:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:0.0:1787734085.749423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734085.749486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734085.749555:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690070912 00000100:00100000:3.0:1787734085.749560:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690070912 00000100:00100000:3.0:1787734085.749594:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1787734085.749601:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:2357:x1874574690070912:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787734085.749639:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:2357:x1874574690070912:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 39us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734085.749646:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:2.0:1787734085.749812:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690070784 00000100:00100000:2.0:1787734085.749817:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690070784 00000100:00100000:2.0:1787734085.749848:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690071168 00000100:00100000:2.0:1787734085.749851:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690071168 00000100:00100000:2.0:1787734085.749865:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1787734085.749870:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:2356:x1874574690070784:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787734085.749907:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:2356:x1874574690070784:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.749919:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1787734085.749931:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1787734085.749936:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2357:x1874574690071168:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787734085.749958:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2357:x1874574690071168:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 22us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.749963:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:2.0:1787734085.883992:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787734085.891276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734085.891385:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690071296 00000100:00100000:2.0:1787734085.891396:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690071296 00000100:00100000:2.0:1787734085.891460:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1787734085.891472:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+6:13902:x1874574690071296:12345-192.168.201.34@tcp:101:mkdir.0 00010000:00010000:2.0:1787734085.891493:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734085.891515:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b000/0x45228d86de4d69b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1988e expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734085.891582:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734085.891596:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734085.891607:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787734085.891817:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787734085.891821:0:14451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787734085.891889:0:14451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734085.891925:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b000/0x45228d86de4d69b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1988e expref: 8 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734085.891940:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1988e expref: 7 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734085.891947:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0fd5e00) 00010000:00010000:2.0:1787734085.891949:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787734085.891952:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891dc729a200, rc 0) 00000100:00100000:2.0:1787734085.892010:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+7:13902:x1874574690071296:12345-192.168.201.34@tcp:101:mkdir.0 Request processed in 541us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734085.892017:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000001:00100000:2.0:1787734086.516066:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf 00000001:00100000:2.0:1787734086.516084:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5cc34a2c-4c56-448f-b60c-fc108953c500 00010000:00010000:1.0:1787734086.907472:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734087.931090:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787734088.253605:0:16408:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787734088.506681:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efef6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3313:1874574705785728:0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.506754:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734088.506829:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705786240:0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.506855:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734088.506884:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787734088.506890:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705786112:0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.506924:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734088.506954:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705785984:0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.506980:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734088.506999:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787734088.507005:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705785856:0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507022:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734088.507038:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705786368:0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734088.507086:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705786240 00000100:00100000:1.0:1787734088.507093:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705786240 00000100:00100000:1.0:1787734088.507135:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705786112 00000100:00100000:1.0:1787734088.507137:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705786112 00000100:00100000:1.0:1787734088.507147:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705786368 00000100:00100000:1.0:1787734088.507148:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705786368 00000100:00100000:1.0:1787734088.507185:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787734088.507194:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705786240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507241:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705786240:12345-0@lo:400:kworker.0 Request processed in 48us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734088.507247:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787734088.507264:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787734088.507269:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705786112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507292:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874574705786112:12345-0@lo:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734088.507320:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787734088.507333:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787734088.507339:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705786368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507368:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705786368:12345-0@lo:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734088.507374:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787734088.507393:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705785984 00000100:00100000:1.0:1787734088.507396:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705785984 00000100:00100000:1.0:1787734088.507419:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705785856 00000100:00100000:1.0:1787734088.507432:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705785856 00000100:00100000:1.0:1787734088.507453:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787734088.507458:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705785984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507485:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705785984:12345-0@lo:400:kworker.0 Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734088.507490:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787734088.507500:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787734088.507516:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705785856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507541:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705785856:12345-0@lo:400:kworker.0 Request processed in 36us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734088.507546:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787734088.507565:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787734088.507568:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787734088.507571:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787734088.507600:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705785856:0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507620:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705786368:0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507631:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705785984:0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507672:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874574705786112:0@lo:400:kworker.0 00000100:00100000:1.0:1787734088.507683:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705786240:0@lo:400:kworker.0 00000100:00100000:2.0:1787734088.508893:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705785728 00000100:00100000:2.0:1787734088.508903:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705785728 00000100:00100000:2.0:1787734088.508965:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787734088.508975:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:3313:x1874574705785728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787734088.509046:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:3313:x1874574705785728:12345-0@lo:400:kworker.0 Request processed in 72us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734088.509052:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787734088.509097:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efef6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3313:1874574705785728:0@lo:400:kworker.0 00000100:00100000:0.0:1787734088.509304:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787734088.509328:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705786496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787734088.509362:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734088.509393:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705786496 00000100:00100000:0.0:1787734088.509396:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705786496 00000100:00100000:0.0:1787734088.509445:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787734088.509452:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705786496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787734088.509479:0:15139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787734088.509514:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874574705786496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734088.509520:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787734088.509553:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705786496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787734088.509958:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705786624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787734088.509990:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734088.511966:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705786624 00000100:00100000:0.0:1787734088.511981:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705786624 00000100:00100000:0.0:1787734088.512061:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787734088.512071:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705786624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787734088.512106:0:15139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787734088.523903:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705786624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11824us (13902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734088.523918:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787734088.529143:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705786624:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787734088.543345:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5cc34a2c-4c56-448f-b60c-fc108953c500 00000001:00100000:0.0:1787734088.543371:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf 00010000:00010000:0.0:1787734088.954370:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734089.978304:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787734090.097757:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5cc34a2c-4c56-448f-b60c-fc108953c500 00000100:00100000:2.0:1787734090.876915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734090.876945:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734090.876973:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690071808 00000100:00100000:2.0:1787734090.876975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734090.876983:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690071808 00000100:00100000:3.0:1787734090.877039:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690072064 00000100:00100000:3.0:1787734090.877042:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690072064 00000100:00100000:3.0:1787734090.877069:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1787734090.877078:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:2355:x1874574690071808:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787734090.877143:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:2355:x1874574690071808:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734090.877151:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1787734090.877189:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1787734090.877195:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+5:2355:x1874574690072064:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787734090.877219:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+5:2355:x1874574690072064:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734090.877226:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00080000:3.0:1787734090.877241:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787734090.877244:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787734090.877664:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690071552 00000100:00100000:1.0:1787734090.877669:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690071552 00000100:00100000:1.0:1787734090.877715:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1787734090.877722:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:2355:x1874574690071552:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787734090.877761:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:2355:x1874574690071552:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734090.877766:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00080000:3.0:1787734090.877881:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787734090.878996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734090.880659:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734090.880682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734090.880707:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734090.880735:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690071936 00000100:00100000:2.0:1787734090.880743:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690071936 00000100:00100000:2.0:1787734090.880794:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1787734090.880803:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2355:x1874574690071936:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787734090.880863:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2355:x1874574690071936:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 61us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734090.880870:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1787734090.880889:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690071680 00000100:00100000:2.0:1787734090.880891:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690071680 00000100:00100000:2.0:1787734090.880910:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690072192 00000100:00100000:2.0:1787734090.880912:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690072192 00000100:00100000:2.0:1787734090.880927:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1787734090.880933:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:2355:x1874574690071680:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787734090.880957:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:2355:x1874574690071680:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734090.880963:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1787734090.880972:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1787734090.880977:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+5:2355:x1874574690072192:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787734090.880994:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+5:2355:x1874574690072192:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 18us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734090.881000:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00080000:2.0:1787734090.881024:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787734090.881027:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787734090.881029:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787734090.881499:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690071424 00000100:00100000:3.0:1787734090.881505:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690071424 00000100:00100000:3.0:1787734090.881530:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:3.0:1787734090.881537:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:2355:x1874574690071424:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787734090.881587:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:2355:x1874574690071424:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 50us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734090.881593:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 103 00010000:00010000:0.0:1787734091.008913:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787734091.498147:0:16559:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff09592430 20000000:00000080:2.0:1787734091.498341:0:16559:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff891dc5724800 uarg=0000000000000000 20000000:01000000:2.0:1787734091.498429:0:16559:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787734091.498436:0:16559:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787734091.498440:0:16559:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787734091.499638:0:16560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787734091.499925:0:16559:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787734091.506979:0:16559:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787734091.507010:0:16559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507029:0:16559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec6658e00/0x45228d86de4d66b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d66b2 expref: 18 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507036:0:16559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec6659c00/0x45228d86de4d6706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d66ff expref: 18 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507043:0:16559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ef6b60200/0x45228d86de4d6776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d676f expref: 18 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507053:0:16559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec0031400/0x45228d86de4d6960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19802 expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507061:0:16559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891ec60cc400/0x45228d86de4d6998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19864 expref: 12 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507068:0:16559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507113:0:16559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec60cc400/0x45228d86de4d6998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19864 expref: 12 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507141:0:16559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec60cc400/0x45228d86de4d6998 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19864 expref: 12 pid: 14444 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734091.507195:0:16559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16559:1874574705786752:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787734091.507309:0:16559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec0031400/0x45228d86de4d6960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19802 expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507318:0:16559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec0031400/0x45228d86de4d6960 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19802 expref: 12 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734091.507325:0:16559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16559:1874574705786880:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787734091.507354:0:16559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ef6b60200/0x45228d86de4d6776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d676f expref: 18 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507362:0:16559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ef6b60200/0x45228d86de4d6776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d676f expref: 18 pid: 14445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734091.507381:0:16559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16559:1874574705787008:0@lo:104: 00000100:00100000:2.0:1787734091.507419:0:16559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734091.507465:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705787008 00000100:00100000:2.0:1787734091.507472:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705787008 00000100:00100000:2.0:1787734091.507520:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787734091.507530:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:16559:x1874574705787008:12345-0@lo:104: 00010000:00010000:2.0:1787734091.507542:0:14434:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507600:0:14434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787734091.507610:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:16559:x1874574705787008:12345-0@lo:104: Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734091.507617:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787734091.507649:0:16559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec6659c00/0x45228d86de4d6706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d66ff expref: 18 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507658:0:16559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec6659c00/0x45228d86de4d6706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d66ff expref: 18 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734091.507677:0:16559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16559:1874574705787136:0@lo:104: 00000100:00100000:2.0:1787734091.507699:0:16559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734091.507716:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705787136 00000100:00100000:2.0:1787734091.507720:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705787136 00000100:00100000:2.0:1787734091.507735:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787734091.507741:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:16559:x1874574705787136:12345-0@lo:104: 00010000:00010000:2.0:1787734091.507748:0:14434:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.507953:0:14434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787734091.507959:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:16559:x1874574705787136:12345-0@lo:104: Request processed in 218us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734091.507966:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787734091.507992:0:16559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891ec6658e00/0x45228d86de4d66b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45228d86de4d66b2 expref: 18 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.508000:0:16559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891ec6658e00/0x45228d86de4d66b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45228d86de4d66b2 expref: 18 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734091.508009:0:16559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16559:1874574705787264:0@lo:104: 00000100:00100000:2.0:1787734091.508043:0:16559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734091.508068:0:14434:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787734091.508079:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705787264 00000100:00100000:2.0:1787734091.508082:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705787264 00000100:00100000:2.0:1787734091.508099:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787734091.508105:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe943c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:16559:x1874574705787264:12345-0@lo:104: 00010000:00010000:2.0:1787734091.508112:0:14434:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734091.508137:0:14434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787734091.508141:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe943c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+3:16559:x1874574705787264:12345-0@lo:104: Request processed in 37us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734091.508146:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787734091.508202:0:16559:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5a440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787734091.508226:0:16559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16559:1874574705787008:0@lo:104: 00000100:00100000:2.0:1787734091.508234:0:16559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16559:1874574705787136:0@lo:104: 00000100:00100000:2.0:1787734091.508240:0:16559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16559:1874574705787264:0@lo:104: 00010000:00010000:3.0:1787734091.508849:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787734091.508857:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.508865:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658c00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787734091.508869:0:14440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.508877:0:14440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787734091.508884:0:14440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734091.508890:0:14440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787734091.508927:0:14440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.508933:0:14440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787734091.508957:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.508963:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ec6658c00/0x45228d86de4d676f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d6776 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.508976:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787734091.508987:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.508992:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0600 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787734091.508995:0:14440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509001:0:14440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787734091.509006:0:14440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734091.509011:0:14440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787734091.509022:0:14440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509028:0:14440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787734091.509047:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509053:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891f020c0600/0x45228d86de4d66ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d6706 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509062:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787734091.509065:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509070:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ef6b61c00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1787734091.509072:0:14440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509087:0:14440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787734091.509093:0:14440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787734091.509098:0:14440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787734091.509110:0:14440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509115:0:14440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787734091.509140:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509147:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff891ef6b61c00/0x45228d86de4d66b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45228d86de4d66b9 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509182:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734091.509184:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787734091.509186:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787734091.509193:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787734091.509208:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705787392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787734091.509244:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734091.509289:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3311:1874574705787648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787734091.509310:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734091.509327:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787734091.509331:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3311:1874574705787520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787734091.509351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734091.509392:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705787392 00000100:00100000:3.0:1787734091.509397:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705787392 00010000:00010000:3.0:1787734091.509419:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ef6b60200/0x45228d86de4d6776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d676f expref: 19 pid: 14445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734091.509435:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705787648 00000100:00100000:3.0:1787734091.509437:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705787648 00010000:00010000:3.0:1787734091.509448:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec6658e00/0x45228d86de4d66b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d66b2 expref: 20 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734091.509457:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705787520 00000100:00100000:3.0:1787734091.509459:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705787520 00010000:00010000:3.0:1787734091.509468:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec6659c00/0x45228d86de4d6706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d66ff expref: 21 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734091.509479:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787734091.509486:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+21:3312:x1874574705787392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787734091.509495:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734091.509500:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ef6b60200/0x45228d86de4d6776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d676f expref: 21 pid: 14445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509509:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ef6b60200/0x45228d86de4d6776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d676f expref: 21 pid: 14445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509521:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ef6b60200/0x45228d86de4d6776 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d676f expref: 21 pid: 14445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509532:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734091.509569:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+20:3312:x1874574705787392:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734091.509575:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787734091.509595:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787734091.509600:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:3311:x1874574705787648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787734091.509608:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734091.509612:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec6658e00/0x45228d86de4d66b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d66b2 expref: 19 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509619:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec6658e00/0x45228d86de4d66b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d66b2 expref: 19 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509628:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec6658e00/0x45228d86de4d66b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d66b2 expref: 19 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509636:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734091.509660:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:3311:x1874574705787648:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734091.509666:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787734091.509688:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787734091.509694:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6194050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:3311:x1874574705787520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787734091.509701:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734091.509705:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec6659c00/0x45228d86de4d6706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45228d86de4d66ff expref: 17 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509712:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec6659c00/0x45228d86de4d6706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45228d86de4d66ff expref: 17 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509721:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec6659c00/0x45228d86de4d6706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45228d86de4d66ff expref: 17 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.509729:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734091.509752:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6194050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:3311:x1874574705787520:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734091.509758:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787734091.509816:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3312:1874574705787392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787734091.509914:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3311:1874574705787520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787734091.509923:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3311:1874574705787648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787734091.510604:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787734091.513069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734091.513103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734091.513189:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690072320 00000100:00100000:3.0:1787734091.513196:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690072320 00010000:00010000:3.0:1787734091.513230:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec60cc400/0x45228d86de4d6998 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19864 expref: 13 pid: 14444 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734091.513260:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690072448 00000100:00100000:3.0:1787734091.513263:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690072448 00010000:00010000:3.0:1787734091.513284:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891ec0031400/0x45228d86de4d6960 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19802 expref: 14 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734091.513299:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787734091.513308:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dee5c0f-8c74-494c-994c-130f4d2be35b+14:2355:x1874574690072320:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787734091.513321:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734091.513327:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec60cc400/0x45228d86de4d6998 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19864 expref: 14 pid: 14444 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513339:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec60cc400/0x45228d86de4d6998 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19864 expref: 14 pid: 14444 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513357:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734091.513402:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dee5c0f-8c74-494c-994c-130f4d2be35b+14:2355:x1874574690072320:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 95us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734091.513424:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787734091.513440:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:3.0:1787734091.513447:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:2355:x1874574690072448:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787734091.513454:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734091.513458:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891ec0031400/0x45228d86de4d6960 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19802 expref: 13 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513468:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891ec0031400/0x45228d86de4d6960 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19802 expref: 13 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513480:0:14437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513490:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513503:0:14437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513511:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513518:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513524:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513530:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729ac00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734091.513540:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513548:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513854:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734091.513867:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734091.513888:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:2355:x1874574690072448:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 441us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734091.513895:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00010000:00010000:1.0:1787734091.514329:0:16559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec60cc400/0x45228d86de4d6998 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19864 expref: 12 pid: 14444 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734091.514346:0:16559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16559:1874574705786752:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787734091.514361:0:16559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891ec0031400/0x45228d86de4d6960 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19802 expref: 11 pid: 14446 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734091.514370:0:16559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16559:1874574705786880:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787734091.516871:0:16559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734091.516892:0:16559:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734091.516899:0:16559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734091.516906:0:16559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891dc729ac00/0x45228d86de4d69c2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734092.026418:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787734092.666870:0:14448:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787734092.666879:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891ec6e5f000 from 10 10000000:01000000:0.0:1787734092.666885:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787734092.666943:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658800/0x45228d86de4d69c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734092.666955:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6658800/0x45228d86de4d69c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734092.666966:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6658800/0x45228d86de4d69c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734092.666992:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705787776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787734092.667057:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734092.667109:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787734092.667756:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705787776 00000100:00100000:3.0:1787734092.667764:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705787776 00000100:00100000:3.0:1787734092.667805:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787734092.667811:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+16:14448:x1874574705787776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787734092.667823:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734092.667833:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0031c00/0x45228d86de4d69d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d69c9 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734092.667851:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0031c00/0x45228d86de4d69d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d69c9 expref: 17 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734092.667859:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0031c00/0x45228d86de4d69d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d69c9 expref: 17 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734092.667865:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031c00, rc 0) 00000100:00100000:3.0:1787734092.667905:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:14448:x1874574705787776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734092.667921:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787734092.668125:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705787776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787734092.668138:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6658800/0x45228d86de4d69c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d69d0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734092.668145:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6658800/0x45228d86de4d69c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d69d0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734092.668209:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705787904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787734092.668230:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734092.668257:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86840 going to sleep for 11 seconds 00000100:00100000:2.0:1787734092.668315:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705787904 00000100:00100000:2.0:1787734092.668318:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705787904 00000100:00100000:2.0:1787734092.668343:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787734092.668354:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:14448:x1874574705787904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787734092.668596:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:14448:x1874574705787904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734092.668603:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787734092.668732:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705787904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787734092.668753:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787734092.668780:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734092.668798:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86840 going to sleep for 11 seconds 00000100:00100000:3.0:1787734092.670685:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705788032 00000100:00100000:3.0:1787734092.670699:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705788032 00000100:00100000:3.0:1787734092.670757:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787734092.670767:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:14448:x1874574705788032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787734092.671001:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:14448:x1874574705788032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734092.671008:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787734092.671188:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787734092.672079:0:16628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787734092.672309:0:14448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787734092.672327:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787734092.672337:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6658800/0x45228d86de4d69c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d69d0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734092.672360:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6658800/0x45228d86de4d69c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d69d0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734092.672371:0:14448:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787734092.672374:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891efe4ce800 from 10 10000000:01000000:0.0:1787734092.672377:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787734092.672418:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659a00/0x45228d86de4d69d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734092.672426:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6659a00/0x45228d86de4d69d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734092.672436:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6659a00/0x45228d86de4d69d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734092.672458:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787734092.672506:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734092.672556:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787734092.672667:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705788160 00000100:00100000:3.0:1787734092.672674:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705788160 00000100:00100000:3.0:1787734092.672712:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787734092.672721:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+17:14448:x1874574705788160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787734092.672731:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734092.672743:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0030c00/0x45228d86de4d69de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d69d7 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734092.672763:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0030c00/0x45228d86de4d69de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d69d7 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734092.672773:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0030c00/0x45228d86de4d69de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d69d7 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734092.672781:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030c00, rc 0) 00000100:00100000:3.0:1787734092.672820:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:14448:x1874574705788160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734092.672826:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787734092.672976:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787734092.672989:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6659a00/0x45228d86de4d69d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d69de expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734092.672997:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6659a00/0x45228d86de4d69d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d69de expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734092.673040:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787734092.673074:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734092.673138:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787734092.673678:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705788288 00000100:00100000:2.0:1787734092.673691:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705788288 00000100:00100000:2.0:1787734092.673727:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787734092.673735:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f01840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:14448:x1874574705788288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787734092.674151:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f01840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:14448:x1874574705788288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 416us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734092.674174:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787734092.674863:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787734092.674900:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787734092.674936:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734092.674973:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a86b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787734092.675031:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705788416 00000100:00100000:3.0:1787734092.675040:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705788416 00000100:00100000:3.0:1787734092.675067:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787734092.675073:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:14448:x1874574705788416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787734092.675210:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:14448:x1874574705788416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734092.675215:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787734092.675283:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787734092.676209:0:16629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787734092.676317:0:14448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787734092.676331:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787734092.676339:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659a00/0x45228d86de4d69d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d69de expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734092.676347:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6659a00/0x45228d86de4d69d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d69de expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787734092.676364:0:14448:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787734092.676366:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff891efe936000 from 10 10000000:01000000:0.0:1787734092.676368:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787734092.676394:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659400/0x45228d86de4d69e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734092.676402:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff891ec6659400/0x45228d86de4d69e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734092.676412:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff891ec6659400/0x45228d86de4d69e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734092.676440:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787734092.676476:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734092.676512:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787734092.676612:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705788544 00000100:00100000:3.0:1787734092.676617:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705788544 00000100:00100000:3.0:1787734092.676645:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787734092.676650:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+18:14448:x1874574705788544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787734092.676658:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734092.676668:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0030800/0x45228d86de4d69ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45228d86de4d69e5 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734092.676683:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0030800/0x45228d86de4d69ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45228d86de4d69e5 expref: 19 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734092.676689:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0030800/0x45228d86de4d69ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45228d86de4d69e5 expref: 19 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734092.676695:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030800, rc 0) 00000100:00100000:3.0:1787734092.676724:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:14448:x1874574705788544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734092.676728:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787734092.676782:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787734092.676792:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff891ec6659400/0x45228d86de4d69e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d69ec expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734092.676798:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff891ec6659400/0x45228d86de4d69e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45228d86de4d69ec expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734092.676827:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787734092.676844:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734092.676863:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787734092.676908:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705788672 00000100:00100000:3.0:1787734092.676913:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705788672 00000100:00100000:3.0:1787734092.676930:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787734092.676936:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:14448:x1874574705788672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787734092.677198:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:14448:x1874574705788672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734092.677205:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787734092.677570:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787734092.677598:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787734092.677633:0:14448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734092.677662:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787734092.677710:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705788800 00000100:00100000:3.0:1787734092.677714:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705788800 00000100:00100000:3.0:1787734092.677740:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787734092.677745:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:14448:x1874574705788800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787734092.677845:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:14448:x1874574705788800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734092.677850:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787734092.677926:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:14448:1874574705788800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787734092.678582:0:16630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787734092.678810:0:14448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787734092.678824:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787734092.678830:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff891ec6659400/0x45228d86de4d69e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d69ec expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734092.678838:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff891ec6659400/0x45228d86de4d69e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45228d86de4d69ec expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734093.053105:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787734093.307044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734093.307127:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690072576 00000100:00100000:3.0:1787734093.307138:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690072576 00000100:00100000:3.0:1787734093.307547:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:3.0:1787734093.307558:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+11:13759:x1874574690072576:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787734093.307576:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734093.307595:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec0031800/0x45228d86de4d69f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df19895 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734093.307625:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec0031800/0x45228d86de4d69f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19895 expref: 12 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734093.307636:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec0031800/0x45228d86de4d69f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19895 expref: 12 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734093.307646:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031800, rc 0) 00000100:00100000:3.0:1787734093.307708:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+12:13759:x1874574690072576:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 152us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734093.307727:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:3.0:1787734093.327625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734093.327839:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690072704 00000100:00100000:1.0:1787734093.327850:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690072704 00000100:00100000:1.0:1787734093.327910:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:1.0:1787734093.327921:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+12:13759:x1874574690072704:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787734093.328205:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+12:13759:x1874574690072704:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 286us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734093.328212:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:0.0:1787734093.332031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734093.332089:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690072832 00000100:00100000:3.0:1787734093.332099:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690072832 00000100:00100000:3.0:1787734093.332240:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:3.0:1787734093.332252:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+12:13759:x1874574690072832:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787734093.332479:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+12:13759:x1874574690072832:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 229us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734093.332487:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:0.0:1787734093.345842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734093.345901:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690072960 00000100:00100000:1.0:1787734093.345911:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690072960 00000100:00100000:1.0:1787734093.346002:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:1.0:1787734093.346011:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+12:13759:x1874574690072960:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787734093.346028:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787734093.346044:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891ec60cc200/0x45228d86de4d69fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16ea362df1989c expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734093.346072:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891ec60cc200/0x45228d86de4d69fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1989c expref: 13 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734093.346096:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891ec60cc200/0x45228d86de4d69fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1989c expref: 13 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734093.346106:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cc200, rc 0) 00000100:00100000:1.0:1787734093.346197:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13759:x1874574690072960:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 187us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734093.346204:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:0.0:1787734093.348538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734093.349054:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690073088 00000100:00100000:3.0:1787734093.349062:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690073088 00000100:00100000:3.0:1787734093.349113:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:3.0:1787734093.349124:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13759:x1874574690073088:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787734093.349661:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13759:x1874574690073088:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 538us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734093.349671:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:0.0:1787734093.363001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734093.363069:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690073216 00000100:00100000:1.0:1787734093.363080:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690073216 00000100:00100000:1.0:1787734093.363149:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:1.0:1787734093.363195:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13759:x1874574690073216:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787734093.363437:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:13759:x1874574690073216:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 242us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734093.363445:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:2.0:1787734093.626452:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705788928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787734093.626536:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734093.626630:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705788928 00000100:00100000:3.0:1787734093.626639:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705788928 00000100:00100000:3.0:1787734093.626724:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787734093.626745:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705788928:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787734093.626834:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1787734093.627010:0:15140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787734093.627573:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705789440:0@lo:400:kworker.0 00000100:00100000:2.0:1787734093.627608:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734093.629938:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3310:1874574705789184:0@lo:400:kworker.0 00000100:00100000:3.0:1787734093.629981:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705788928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3237us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734093.629992:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787734093.630007:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734093.630058:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787734093.630066:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891eeff2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705789312:0@lo:400:kworker.0 00000100:00100000:0.0:1787734093.630095:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734093.630128:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705789056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787734093.630168:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734093.630197:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705789056 00000100:00100000:0.0:1787734093.630204:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705789056 00000100:00100000:0.0:1787734093.630251:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787734093.630259:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705789056:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787734093.630298:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705789440 00000100:00100000:3.0:1787734093.630316:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705789440 00000100:00100000:3.0:1787734093.630345:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787734093.630352:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705789440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787734093.630709:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874574705789440:12345-0@lo:400:kworker.0 Request processed in 356us (3099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734093.630717:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787734093.630747:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705789312 00000100:00100000:3.0:1787734093.630750:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705789312 00000100:00100000:3.0:1787734093.630968:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787734093.630977:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705789312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787734093.631283:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874574705789312:12345-0@lo:400:kworker.0 Request processed in 307us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734093.631290:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787734093.631334:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787734093.631345:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705789184 00000100:00100000:3.0:1787734093.631349:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705789184 00000100:00100000:3.0:1787734093.631375:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787734093.631496:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:3310:x1874574705789184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787734093.631684:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:3310:x1874574705789184:12345-0@lo:400:kworker.0 Request processed in 191us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734093.631691:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00002000:00000024:0.0:1787734093.632479:0:15139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787734093.632538:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705789056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2278us (2382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734093.632545:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787734093.632606:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874574705789312:0@lo:400:kworker.0 00000100:00100000:0.0:1787734093.632614:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787734093.632626:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705789696:0@lo:400:kworker.0 00000100:00100000:0.0:1787734093.632674:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734093.632752:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705789696 00000100:00100000:0.0:1787734093.632757:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705789696 00000100:00100000:3.0:1787734093.632793:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3310:1874574705789184:0@lo:400:kworker.0 00000100:00100000:0.0:1787734093.632807:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787734093.632814:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705789696:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787734093.632816:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787734093.632854:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874574705789696:12345-0@lo:400:kworker.0 Request processed in 41us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734093.632860:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787734093.632884:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874574705789696:0@lo:400:kworker.0 00000100:00100000:3.0:1787734093.632962:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705789568:0@lo:400:kworker.0 00000100:00100000:3.0:1787734093.632990:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787734093.633239:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705788928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787734093.633266:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891eeff2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874574705789440:0@lo:400:kworker.0 00000100:00100000:3.0:1787734093.635879:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705789056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787734093.640900:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705789568 00000100:00100000:0.0:1787734093.640915:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705789568 00000100:00080000:3.0:1787734093.640973:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787734093.640995:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787734093.641006:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705789568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787734093.641108:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874574705789568:12345-0@lo:400:kworker.0 Request processed in 104us (8116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734093.641116:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787734093.641198:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874574705789568:0@lo:400:kworker.0 00010000:00010000:3.0:1787734094.074386:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787734094.278642:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.278791:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690073344 00000100:00100000:3.0:1787734094.278803:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690073344 00000100:00100000:3.0:1787734094.278884:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1787734094.278894:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:14415:x1874574690073344:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787734094.278915:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734094.278939:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6a01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198a3 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279008:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6a08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279022:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6a08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279034:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6a08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279049:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6a0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279057:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6a0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279063:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6a0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279554:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0600/0x45228d86de4d6a16 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279566:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0600/0x45228d86de4d6a16 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279573:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0600/0x45228d86de4d6a16 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787734094.279658:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787734094.279662:0:14452:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787734094.279753:0:14452:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0600/0x45228d86de4d6a16 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279765:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6a08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279772:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6a08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279778:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6a08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279784:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734094.279788:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6a08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279795:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6a08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279807:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0fd5e00) 00010000:00010000:3.0:1787734094.279817:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787734094.279823:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6a08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279829:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6a08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279842:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6a0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279849:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6a0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279854:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6a0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279859:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734094.279862:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6a0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279868:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6a0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279876:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff891ec6634f00) 00010000:00010000:3.0:1787734094.279878:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787734094.279881:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6a0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279886:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6a0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279922:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6a01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198a3 expref: 8 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279948:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0600/0x45228d86de4d6a16 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198a3 expref: 7 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.279956:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff891ec6634a00) 00010000:00010000:3.0:1787734094.279958:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787734094.279961:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891f020c0600, rc 0) 00000100:00100000:3.0:1787734094.280037:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:14415:x1874574690073344:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1143us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734094.280046:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00080000:0.0:1787734094.280358:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787734094.285145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734094.285276:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690073600 00000100:00100000:2.0:1787734094.285287:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690073600 00000100:00100000:2.0:1787734094.285347:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1787734094.285358:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:14415:x1874574690073600:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787734094.285377:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734094.285397:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729ae00/0x45228d86de4d6a1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198aa expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.285472:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a600/0x45228d86de4d6a24 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.285486:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a600/0x45228d86de4d6a24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.285496:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a600/0x45228d86de4d6a24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.285535:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729be00/0x45228d86de4d6a2b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.285542:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729be00/0x45228d86de4d6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.285548:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729be00/0x45228d86de4d6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286037:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a000/0x45228d86de4d6a32 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286047:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a000/0x45228d86de4d6a32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286053:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a000/0x45228d86de4d6a32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787734094.286062:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787734094.286339:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a600/0x45228d86de4d6a24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286347:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a600/0x45228d86de4d6a24 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286353:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a600/0x45228d86de4d6a24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286359:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729a600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787734094.286363:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a600/0x45228d86de4d6a24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286381:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a600/0x45228d86de4d6a24 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286395:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff891ec6634a00) 00010000:00010000:2.0:1787734094.286398:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787734094.286403:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a600/0x45228d86de4d6a24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286409:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a600/0x45228d86de4d6a24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286421:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729be00/0x45228d86de4d6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286427:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729be00/0x45228d86de4d6a2b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286432:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729be00/0x45228d86de4d6a2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286437:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729be00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787734094.286439:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729be00/0x45228d86de4d6a2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286445:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729be00/0x45228d86de4d6a2b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286451:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff891ee0fd5d00) 00010000:00010000:2.0:1787734094.286454:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787734094.286456:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729be00/0x45228d86de4d6a2b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286471:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729be00/0x45228d86de4d6a2b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286850:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729ae00/0x45228d86de4d6a1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198aa expref: 10 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286865:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a000/0x45228d86de4d6a32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198aa expref: 9 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.286872:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ee0fd5700) 00010000:00010000:2.0:1787734094.286874:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787734094.286876:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891dc729a000, rc 0) 00000100:00100000:2.0:1787734094.286944:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+9:14415:x1874574690073600:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1588us (1808us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787734094.286952:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1787734094.295610:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.295864:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690073728 00000100:00100000:3.0:1787734094.295876:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690073728 00000100:00100000:3.0:1787734094.295946:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1787734094.295958:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+9:14415:x1874574690073728:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787734094.296066:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+9:14415:x1874574690073728:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 111us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734094.296073:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1787734094.329097:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.329220:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690073856 00000100:00100000:0.0:1787734094.329231:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690073856 00000100:00100000:0.0:1787734094.329291:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:0.0:1787734094.329302:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+9:14421:x1874574690073856:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787734094.329322:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734094.329354:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198b1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329415:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329445:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329457:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329472:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329479:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329486:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329916:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329925:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329932:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329939:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734094.329944:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329951:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329964:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0fd5e00) 00010000:00010000:0.0:1787734094.329973:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734094.329979:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329985:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.329999:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.330005:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.330011:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.330016:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734094.330019:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.330025:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.330032:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff891ec6771d00) 00010000:00010000:0.0:1787734094.330034:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734094.330037:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.330042:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.330073:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198b1 expref: 10 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.330088:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0fd5e00) 00010000:00010000:0.0:1787734094.330091:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734094.330094:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198b1 expref: 10 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.330104:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659e00, rc 0) 00000100:00100000:0.0:1787734094.330253:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+9:14421:x1874574690073856:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 952us (1164us total) trans 0 rc 301/301 00000100:00100000:0.0:1787734094.330261:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:0.0:1787734094.336401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.336578:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690073984 00000100:00100000:3.0:1787734094.336589:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690073984 00000100:00100000:3.0:1787734094.336647:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1787734094.336658:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+9:14421:x1874574690073984:12345-192.168.201.34@tcp:700:lfs.0 00000100:00100000:3.0:1787734094.336747:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+9:14421:x1874574690073984:12345-192.168.201.34@tcp:700:lfs.0 Request processed in 91us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734094.336756:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1787734094.338632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.338734:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690074240 00000100:00100000:0.0:1787734094.338741:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690074240 00000100:00100000:0.0:1787734094.338784:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787734094.338792:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+9:14421:x1874574690074240:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:0.0:1787734094.338839:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787734094.338863:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a400/0x45228d86de4d6983 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1982c expref: 9 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.338881:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0fd5e00) 00010000:00010000:0.0:1787734094.338886:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787734094.339113:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.339126:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1988e expref: 5 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.339146:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.339218:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1988e expref: 5 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.339231:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1988e expref: 5 pid: 14451 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734094.339245:0:14453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14453:1874574705789824:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787734094.339339:0:14453:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b9240 going to sleep for 11 seconds 00000100:00100000:1.0:1787734094.344662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.344754:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690074368 00000100:00100000:3.0:1787734094.344763:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690074368 00010000:00010000:3.0:1787734094.344829:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1988e expref: 6 pid: 14451 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734094.344870:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1787734094.344880:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2355:x1874574690074368:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787734094.344895:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734094.344902:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1988e expref: 6 pid: 14451 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.344917:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1988e expref: 6 pid: 14451 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.344938:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0fd5e00) 00010000:00010000:3.0:1787734094.344943:0:14437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.344953:0:14437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.344961:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.344979:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734094.345024:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2355:x1874574690074368:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 146us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734094.345031:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00010000:00010000:0.0:1787734094.345621:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729a200/0x45228d86de4d69bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df1988e expref: 5 pid: 14451 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734094.345639:0:14453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14453:1874574705789824:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787734094.345659:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.345668:0:14453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.345674:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.345696:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.345706:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.345728:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787734094.346286:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787734094.348291:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787734094.348308:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.348319:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.348327:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.348333:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734094.348338:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.348346:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.348361:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ee0fd5e00) 00010000:00010000:0.0:1787734094.348364:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734094.348368:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.348374:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a55 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787734094.348393:0:14453:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c92057d reply state 000000003e696502 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734094.348415:0:14453:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787734094.348519:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+10:14421:x1874574690074240:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 9712us (9877us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787734094.348529:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00010000:00010000:2.0:1787734094.365536:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.365554:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.365562:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.365569:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787734094.365574:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.365596:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.365614:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff891ec6771d00) 00010000:00010000:2.0:1787734094.365617:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787734094.365622:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734094.365628:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6a5c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734094.441566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.442368:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690074496 00000100:00100000:0.0:1787734094.442381:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690074496 00000100:00100000:0.0:1787734094.442448:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1787734094.442460:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+9:14429:x1874574690074496:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:0.0:1787734094.442486:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734094.442522:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198b8 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.442589:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.442602:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.442613:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787734094.442672:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787734094.442677:0:14451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787734094.442725:0:14451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.442752:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198b8 expref: 11 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.442787:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659000/0x45228d86de4d6a6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198b8 expref: 10 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.442796:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:0.0:1787734094.442799:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787734094.442803:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659000, rc 0) 00000100:00100000:0.0:1787734094.442871:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+10:14429:x1874574690074496:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 413us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734094.442878:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:1.0:1787734094.488536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.488634:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690074624 00000100:00100000:0.0:1787734094.488643:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690074624 00000100:00100000:0.0:1787734094.488850:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1787734094.488862:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+5:14430:x1874574690074624:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787734094.488884:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734094.488903:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198bf expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.488967:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6a78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.488981:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6a78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.488992:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6a78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787734094.489053:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787734094.489070:0:14453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787734094.489098:0:14453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6a78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.489123:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198bf expref: 7 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.489141:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658e00/0x45228d86de4d6a78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198bf expref: 6 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.489150:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:0.0:1787734094.489768:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787734094.489774:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658e00, rc 0) 00000100:00100000:0.0:1787734094.489844:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+6:14430:x1874574690074624:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 983us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734094.489852:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1787734094.493568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.493649:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690074752 00000100:00100000:3.0:1787734094.493807:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690074752 00000100:00100000:3.0:1787734094.493908:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:3.0:1787734094.493920:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+6:14430:x1874574690074752:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787734094.493941:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734094.493960:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6a7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198c6 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494023:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6a86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494037:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494048:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494063:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6a8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494070:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494076:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494205:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6a94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494214:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6a94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494221:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6a94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787734094.494266:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787734094.494270:0:14452:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787734094.494296:0:14452:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6a94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494308:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494314:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6a86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494333:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6a86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494340:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734094.494344:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6a86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494351:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6a86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494362:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:3.0:1787734094.494365:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787734094.494370:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494376:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494389:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494403:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6a8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494409:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494413:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734094.494416:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494422:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6a8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494429:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff891ec6634f00) 00010000:00010000:3.0:1787734094.494432:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787734094.494434:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6a8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494439:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6a8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494469:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6a7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198c6 expref: 8 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494482:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6a94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198c6 expref: 7 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.494489:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff891ec6634600) 00010000:00010000:3.0:1787734094.494491:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787734094.494498:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030a00, rc 0) 00000100:00100000:3.0:1787734094.494578:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+7:14430:x1874574690074752:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 661us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734094.494585:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:2.0:1787734094.506544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.507407:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690075008 00000100:00100000:0.0:1787734094.507417:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690075008 00000100:00100000:0.0:1787734094.507471:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:0.0:1787734094.507480:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+7:14430:x1874574690075008:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787734094.507500:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734094.507529:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198cd expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787734094.507633:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787734094.507743:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a9b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198cd expref: 9 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.507757:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:0.0:1787734094.507770:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787734094.507776:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6a9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198cd expref: 9 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.507788:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659e00, rc 0) 00000100:00100000:0.0:1787734094.507841:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+8:14430:x1874574690075008:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 362us (1308us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787734094.507849:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1787734094.514569:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.515255:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690075264 00000100:00100000:3.0:1787734094.515267:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690075264 00000100:00100000:3.0:1787734094.515336:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1787734094.515346:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+8:14430:x1874574690075264:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:3.0:1787734094.515407:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734094.515435:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6a94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198c6 expref: 8 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.515454:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff891ec6634600) 00010000:00010000:3.0:1787734094.515466:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787734094.515489:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.515500:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.515521:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787734094.515866:0:14452:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2f3856c reply state 00000000a7ae3e88 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734094.515877:0:14452:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787734094.515891:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787734094.516843:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+9:14430:x1874574690075264:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 1493us (2279us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787734094.516871:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00010000:00010000:3.0:1787734094.530889:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.530905:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.530913:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.530918:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0031400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734094.530923:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.530930:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.530947:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:3.0:1787734094.530950:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787734094.530955:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.530961:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6aa9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734094.531124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.531570:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690075520 00000100:00100000:3.0:1787734094.531580:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690075520 00000100:00100000:3.0:1787734094.531677:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1787734094.531688:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+8:14430:x1874574690075520:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787734094.531949:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+9:14430:x1874574690075520:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 261us (827us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787734094.531968:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1787734094.540913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734094.541568:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690075776 00000100:00100000:1.0:1787734094.541581:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690075776 00000100:00100000:1.0:1787734094.541644:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:1.0:1787734094.541654:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+9:14430:x1874574690075776:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787734094.541678:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787734094.541712:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d6ab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198d4 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.541806:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6ab7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.541820:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.541832:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.541846:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd800/0x45228d86de4d6abe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.541853:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd800/0x45228d86de4d6abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.541860:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd800/0x45228d86de4d6abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787734094.541982:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787734094.542066:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542074:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542080:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542086:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cdc00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787734094.542091:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542108:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542122:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:1.0:1787734094.542124:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787734094.542129:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6ab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542135:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cdc00/0x45228d86de4d6ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542152:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd800/0x45228d86de4d6abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542184:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd800/0x45228d86de4d6abe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542190:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd800/0x45228d86de4d6abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542195:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cd800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787734094.542198:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd800/0x45228d86de4d6abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542203:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd800/0x45228d86de4d6abe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542211:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff891ec28ef800) 00010000:00010000:1.0:1787734094.542214:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787734094.542216:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd800/0x45228d86de4d6abe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542231:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd800/0x45228d86de4d6abe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542269:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d6ab0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198d4 expref: 11 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542280:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:1.0:1787734094.542282:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787734094.542286:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cd400/0x45228d86de4d6ab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198d4 expref: 11 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.542295:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec60cd400, rc 0) 00000100:00100000:1.0:1787734094.542361:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+10:14430:x1874574690075776:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 708us (1457us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787734094.542368:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1787734094.545626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.553630:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690075904 00000100:00100000:3.0:1787734094.553650:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690075904 00000100:00100000:3.0:1787734094.553716:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1787734094.553727:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+10:14430:x1874574690075904:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787734094.553765:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734094.553790:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6acc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198db expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.553879:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.553892:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.553902:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787734094.553952:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787734094.553956:0:14452:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787734094.553979:0:14452:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.554005:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6acc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198db expref: 12 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.554024:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198db expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.554051:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:3.0:1787734094.554054:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787734094.554058:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030a00, rc 0) 00000100:00100000:3.0:1787734094.554121:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+11:14430:x1874574690075904:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 395us (8503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734094.554128:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1787734094.568615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734094.568803:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690076032 00000100:00100000:1.0:1787734094.568814:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690076032 00000100:00100000:1.0:1787734094.568932:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1787734094.568945:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+11:14430:x1874574690076032:12345-192.168.201.34@tcp:37:lfs.0 00000100:00100000:1.0:1787734094.576461:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cc34a2c-4c56-448f-b60c-fc108953c500+11:14430:x1874574690076032:12345-192.168.201.34@tcp:37:lfs.0 Request processed in 7507us (7843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734094.576476:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1787734094.583688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.583778:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690076288 00000100:00100000:3.0:1787734094.583789:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690076288 00000100:00100000:3.0:1787734094.583846:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1787734094.583856:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed0b71c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+11:14430:x1874574690076288:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787734094.584114:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed0b71c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+12:14430:x1874574690076288:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 259us (436us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787734094.584121:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000040:00080000:3.0:1787734094.586831:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787734094.664104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.664209:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690076416 00000100:00100000:0.0:1787734094.664219:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690076416 00000100:00100000:0.0:1787734094.664277:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:0.0:1787734094.664297:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+10:14436:x1874574690076416:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787734094.664315:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734094.664466:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6ada lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198e2 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664561:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ae1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664574:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664585:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664599:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6ae8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664621:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664628:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664735:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6aef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664745:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6aef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664752:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6aef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787734094.664784:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787734094.664788:0:14453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787734094.664831:0:14453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6aef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664844:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664850:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664856:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664862:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734094.664866:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664879:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664891:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:0.0:1787734094.664895:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734094.664900:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664906:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664921:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664927:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664943:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664948:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734094.664951:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664956:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664962:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff891ec6771300) 00010000:00010000:0.0:1787734094.664965:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734094.664967:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6ae8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.664983:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6ae8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.665013:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6ada lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e2 expref: 12 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.665026:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659e00/0x45228d86de4d6aef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e2 expref: 11 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.665034:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:0.0:1787734094.665036:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787734094.665039:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659e00, rc 0) 00000100:00100000:0.0:1787734094.665105:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+11:14436:x1874574690076416:12345-192.168.201.34@tcp:101:bash.0 Request processed in 810us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734094.665112:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:2.0:1787734094.669977:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.670035:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690076672 00000100:00100000:0.0:1787734094.670043:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690076672 00000100:00100000:0.0:1787734094.670089:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1787734094.670096:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+11:14436:x1874574690076672:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787734094.670115:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734094.670134:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6af6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198e9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.670270:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.670282:0:14451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198db expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.670303:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.670346:0:14451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198db expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.670360:0:14451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198db expref: 11 pid: 14452 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734094.670375:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efec77100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1874574705789952:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787734094.670456:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ef66b90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787734094.673968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.674027:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690076800 00000100:00100000:3.0:1787734094.674035:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690076800 00010000:00010000:3.0:1787734094.674069:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198db expref: 12 pid: 14452 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734094.674103:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787734094.674112:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+12:2355:x1874574690076800:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787734094.674126:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734094.674132:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198db expref: 12 pid: 14452 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.674194:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198db expref: 12 pid: 14452 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.674212:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:3.0:1787734094.674216:0:14438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.674224:0:14438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.674229:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.674256:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734094.674296:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+12:2355:x1874574690076800:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 185us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734094.674303:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00010000:00010000:0.0:1787734094.674624:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6ad3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198db expref: 11 pid: 14452 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734094.674643:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efec77100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1874574705789952:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787734094.674664:0:14451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.674673:0:14451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.674679:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.674717:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.674728:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.674744:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675307:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675314:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675322:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787734094.675333:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787734094.675371:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675376:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675380:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675384:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734094.675387:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675392:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675398:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:0.0:1787734094.675400:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734094.675407:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675411:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6afd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787734094.675418:0:14451:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cc1b7c1 reply state 00000000a8b2b6d0 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734094.675424:0:14451:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787734094.675446:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6af6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e9 expref: 14 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675456:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e9 expref: 13 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.675461:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787734094.675462:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787734094.675464:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659c00, rc 0) 00000100:00100000:0.0:1787734094.675516:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+14:14436:x1874574690076672:12345-192.168.201.34@tcp:101:bash.0 Request processed in 5419us (5546us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787734094.675523:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00010000:00010000:1.0:1787734094.681689:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.681710:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.681733:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.681740:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:1.0:1787734094.681745:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.681753:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.681769:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff891ec6771300) 00010000:00010000:1.0:1787734094.681773:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787734094.681778:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734094.681785:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b04 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734094.690947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.691661:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690076928 00000100:00100000:0.0:1787734094.691671:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690076928 00000100:00100000:0.0:1787734094.692023:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:0.0:1787734094.692034:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+13:14436:x1874574690076928:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787734094.692056:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734094.692077:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b19 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198f0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.692188:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.692202:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.692212:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787734094.692248:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787734094.692252:0:14453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787734094.692269:0:14453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.692278:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.692312:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b19 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f0 expref: 15 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.692339:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f0 expref: 14 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.692489:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787734094.692493:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787734094.692496:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6659200, rc 0) 00000100:00100000:0.0:1787734094.692571:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+14:14436:x1874574690076928:12345-192.168.201.34@tcp:101:bash.0 Request processed in 539us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734094.692577:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1787734094.697842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.699197:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690077184 00000100:00100000:3.0:1787734094.699211:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690077184 00000100:00100000:3.0:1787734094.699267:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1787734094.699278:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+14:14436:x1874574690077184:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:3.0:1787734094.699665:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+15:14436:x1874574690077184:12345-192.168.201.34@tcp:35:bash.0 Request processed in 387us (1832us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787734094.699674:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:2.0:1787734094.778578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.778658:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690077440 00000100:00100000:0.0:1787734094.778669:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690077440 00000100:00100000:0.0:1787734094.778727:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:0.0:1787734094.778738:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+15:14446:x1874574690077440:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787734094.778761:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734094.778781:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198f7 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787734094.778894:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787734094.779208:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f7 expref: 17 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.779223:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891ec6771f00) 00010000:00010000:0.0:1787734094.779225:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787734094.779231:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f7 expref: 17 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.779246:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658c00, rc 0) 00000100:00100000:0.0:1787734094.779306:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+16:14446:x1874574690077440:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 569us (737us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787734094.779857:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1787734094.786478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.786562:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690077696 00000100:00100000:3.0:1787734094.786573:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690077696 00000100:00100000:3.0:1787734094.786630:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1787734094.786654:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+16:14446:x1874574690077696:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787734094.786923:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+17:14446:x1874574690077696:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 271us (455us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787734094.786941:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1787734094.825702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.826047:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690077952 00000100:00100000:0.0:1787734094.826057:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690077952 00000100:00100000:0.0:1787734094.826130:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:0.0:1787734094.826142:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+17:14449:x1874574690077952:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787734094.826206:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734094.826228:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b35 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df198fe expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.826579:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6b3c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.826593:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6b3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.826605:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6b3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787734094.826618:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787734094.826740:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b35 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198fe expref: 20 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.826761:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6b3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198fe expref: 19 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.826770:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787734094.826773:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787734094.826777:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658600, rc 0) 00000100:00100000:0.0:1787734094.826842:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+19:14449:x1874574690077952:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 702us (1149us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787734094.826849:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:2.0:1787734094.830800:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734094.830877:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690078080 00000100:00100000:0.0:1787734094.830886:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690078080 00000100:00100000:0.0:1787734094.830951:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787734094.830962:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+19:14449:x1874574690078080:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787734094.831038:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.831066:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.831077:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.831111:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.831118:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b4a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.831124:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.831129:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734094.831134:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.831140:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b4a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.831150:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787734094.831179:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787734094.831184:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b4a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734094.831190:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734094.831259:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+19:14449:x1874574690078080:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 298us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734094.831272:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:2.0:1787734094.834240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.834599:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690078336 00000100:00100000:3.0:1787734094.834608:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690078336 00000100:00100000:3.0:1787734094.834657:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787734094.834666:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+19:14449:x1874574690078336:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787734094.834889:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+20:14449:x1874574690078336:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 223us (657us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787734094.834896:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1787734094.840091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734094.840185:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690078464 00000100:00100000:3.0:1787734094.840194:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690078464 00000100:00100000:3.0:1787734094.840252:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1787734094.840260:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+20:2355:x1874574690078464:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787734094.840277:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734094.840300:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6b3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198fe expref: 20 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734094.840327:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787734094.840332:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734094.840382:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+19:2355:x1874574690078464:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 122us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734094.840390:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1787734095.053478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.053602:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690078720 00000100:00100000:0.0:1787734095.053612:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690078720 00000100:00100000:0.0:1787734095.053716:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:0.0:1787734095.053726:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+19:14480:x1874574690078720:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1787734095.053750:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734095.053769:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b51 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19905 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.053876:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b58 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.053889:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.053902:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787734095.053913:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787734095.054052:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b51 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19905 expref: 22 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.054073:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19905 expref: 21 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.054082:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787734095.054085:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787734095.054088:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658c00, rc 0) 00000100:00100000:0.0:1787734095.054230:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+21:14480:x1874574690078720:12345-192.168.201.34@tcp:101:cat.0 Request processed in 504us (763us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787734095.054238:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:2.0:1787734095.057371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734095.057415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.057485:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690078976 00000100:00100000:3.0:1787734095.057515:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690078976 00000100:00100000:3.0:1787734095.057565:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:3.0:1787734095.057574:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+21:14480:x1874574690078976:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:3.0:1787734095.057872:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+22:14480:x1874574690078976:12345-192.168.201.34@tcp:35:cat.0 Request processed in 297us (602us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787734095.057880:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1787734095.058079:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690079104 00000100:00100000:1.0:1787734095.058084:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690079104 00000100:00100000:1.0:1787734095.058124:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1787734095.058131:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+22:2354:x1874574690079104:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787734095.058142:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787734095.058193:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19905 expref: 22 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.058212:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:1.0:1787734095.058218:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787734095.058253:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+21:2354:x1874574690079104:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 122us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734095.058260:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00010000:00010000:1.0:1787734095.099554:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787734095.106422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.106530:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690079360 00000100:00100000:3.0:1787734095.106540:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690079360 00000100:00100000:3.0:1787734095.106588:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1787734095.106598:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+21:14486:x1874574690079360:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:3.0:1787734095.106623:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734095.106644:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6b66 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1990c expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.106735:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.106750:0:14452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e9 expref: 22 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.106755:0:14452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f0 expref: 22 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.106760:0:14452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.106843:0:14452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f0 expref: 22 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.106868:0:14452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f0 expref: 22 pid: 14453 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.106878:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14452:1874574705790080:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787734095.107013:0:14452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e9 expref: 22 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.107023:0:14452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e9 expref: 22 pid: 14451 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.107033:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891f018fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14452:1874574705790208:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787734095.107051:0:14452:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed8f93900 going to sleep for 11 seconds 00000100:00100000:3.0:1787734095.109116:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14452:1874574705790208:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787734095.109611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.109867:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690079488 00000100:00100000:0.0:1787734095.109874:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690079488 00010000:00010000:0.0:1787734095.109906:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e9 expref: 23 pid: 14451 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734095.109948:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:0.0:1787734095.109958:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef6194850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+23:2354:x1874574690079488:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787734095.109973:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787734095.109979:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e9 expref: 23 pid: 14451 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.109987:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e9 expref: 23 pid: 14451 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.110005:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198e9 expref: 23 pid: 14451 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.110016:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787734095.110020:0:14438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.110027:0:14438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.110031:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787734095.110083:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef6194850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+22:2354:x1874574690079488:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 128us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.110088:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1787734095.111407:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891f018fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14452:1874574705790080:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787734095.111440:0:14452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734095.111473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.111536:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690079616 00000100:00100000:3.0:1787734095.111542:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690079616 00010000:00010000:3.0:1787734095.111568:0:14436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f0 expref: 22 pid: 14453 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.111617:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1787734095.111624:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+22:2354:x1874574690079616:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787734095.111654:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734095.111659:0:14436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f0 expref: 22 pid: 14453 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.111668:0:14436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f0 expref: 22 pid: 14453 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.111683:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df198f0 expref: 22 pid: 14453 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.111696:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787734095.111701:0:14436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.111709:0:14436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.111716:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.111746:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734095.111786:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+21:2354:x1874574690079616:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 163us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.111791:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00010000:00010000:1.0:1787734095.113201:0:14452:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.113212:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787734095.113230:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787734095.113410:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031400/0x45228d86de4d6b66 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1990c expref: 22 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.113430:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0031000/0x45228d86de4d6b6d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1990c expref: 21 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.113439:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:1.0:1787734095.113442:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787734095.113445:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031000, rc 0) 00000100:00100000:1.0:1787734095.113511:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+21:14486:x1874574690079360:12345-192.168.201.34@tcp:101:dd.0 Request processed in 6914us (7100us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787734095.113519:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1787734095.115112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.115175:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690079872 00000100:00100000:0.0:1787734095.115185:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690079872 00000100:00100000:0.0:1787734095.115230:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:0.0:1787734095.115239:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+21:14486:x1874574690079872:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:0.0:1787734095.115515:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.115528:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.115535:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787734095.115572:0:14453:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787734095.115597:0:14453:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa54c2af reply state 00000000b62c4a08 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734095.115603:0:14453:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787734095.115668:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+24:14486:x1874574690079872:12345-192.168.201.34@tcp:36:dd.0 Request processed in 430us (560us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787734095.115675:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000020:00080000:0.0:1787734095.115680:0:14453:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787734095.116662:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.116673:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.116759:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.116765:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658000 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734095.116770:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.116778:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.116793:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787734095.116796:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787734095.116801:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.116807:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b7b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734095.117985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.118016:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690080000 00000100:00100000:3.0:1787734095.118024:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690080000 00000100:00100000:3.0:1787734095.118073:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:1.0:1787734095.118081:0:14451:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787734095.118083:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eeff2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+23:14486:x1874574690080000:12345-192.168.201.34@tcp:101:dd.0 00000100:00100000:1.0:1787734095.118089:0:14451:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00010000:3.0:1787734095.118379:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734095.118399:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6b82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19913 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.118455:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6b82 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19913 expref: 24 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.118481:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6b82 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19913 expref: 24 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.118513:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787734095.118517:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787734095.118520:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0030a00, rc 0) 00000100:00100000:3.0:1787734095.118596:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eeff2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+24:14486:x1874574690080000:12345-192.168.201.34@tcp:101:dd.0 Request processed in 514us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.118600:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:2.0:1787734095.127191:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734095.127256:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690080256 00000100:00100000:1.0:1787734095.127279:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690080256 00000100:00100000:1.0:1787734095.127348:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1787734095.127359:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+24:14486:x1874574690080256:12345-192.168.201.34@tcp:103:dd.0 00010000:00010000:1.0:1787734095.127375:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787734095.127401:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6b82 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19913 expref: 24 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.127421:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:1.0:1787734095.127426:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787734095.127486:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+23:14486:x1874574690080256:12345-192.168.201.34@tcp:103:dd.0 Request processed in 129us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734095.127502:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1787734095.129346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.129434:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690080384 00000100:00100000:0.0:1787734095.129441:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690080384 00000100:00100000:0.0:1787734095.129493:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:0.0:1787734095.129530:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+23:14486:x1874574690080384:12345-192.168.201.34@tcp:58:dd.0 00010000:00010000:0.0:1787734095.129615:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.129641:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.129651:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787734095.130401:0:14453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787734095.130558:0:14453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787734095.130630:0:14453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787734095.130740:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+23:14486:x1874574690080384:12345-192.168.201.34@tcp:58:dd.0 Request processed in 1210us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.130749:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:2.0:1787734095.133954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.134197:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690080512 00000100:00100000:0.0:1787734095.134208:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690080512 00000100:00100000:0.0:1787734095.134260:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1787734095.134270:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+23:14486:x1874574690080512:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:0.0:1787734095.134289:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734095.134323:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b90 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1991a expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.134379:0:14451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.134390:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b90 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1991a expref: 24 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.134409:0:14451:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.134442:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b90 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1991a expref: 24 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.134456:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787734095.134459:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787734095.134462:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b90 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1991a expref: 24 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.134469:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec6658000, rc 0) 00000100:00100000:0.0:1787734095.134548:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+24:14486:x1874574690080512:12345-192.168.201.34@tcp:101:dd.0 Request processed in 279us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.134555:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000040:00080000:1.0:1787734095.610578:0:14485:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787734095.610588:0:14485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787734095.610650:0:14485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787734095.610656:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787734095.611219:0:14485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14485:1874574705790336:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787734095.611377:0:14485:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec2a860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787734095.624281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.624942:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690080640 00000100:00100000:0.0:1787734095.624953:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690080640 00000100:00100000:0.0:1787734095.625008:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787734095.625021:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+25:14488:x1874574690080640:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787734095.625111:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+25:14488:x1874574690080640:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 Request processed in 86us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.625119:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1787734095.627260:0:14485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14485:1874574705790336:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787734095.635010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.638011:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690080768 00000100:00100000:0.0:1787734095.638025:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690080768 00000100:00100000:0.0:1787734095.638098:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1787734095.638381:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+24:14488:x1874574690080768:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787734095.638415:0:14453:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787734095.638555:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+24:14488:x1874574690080768:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 178us (3557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.641223:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1787734095.645254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.645405:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690080896 00000100:00100000:0.0:1787734095.645415:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690080896 00000100:00100000:0.0:1787734095.645518:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1787734095.645538:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+24:14488:x1874574690080896:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787734095.645631:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b97 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645646:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645657:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645691:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645698:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645704:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645728:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645736:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645742:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787734095.645800:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787734095.645804:0:14451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787734095.645819:0:14451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645830:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645837:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b97 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645843:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645849:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659200 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734095.645853:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645861:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b97 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645873:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ee0fd5700) 00010000:00010000:0.0:1787734095.645876:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734095.645880:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645886:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6b97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645897:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645914:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b9e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645920:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645926:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734095.645929:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645935:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b9e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645943:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff891ec6771100) 00010000:00010000:0.0:1787734095.645946:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734095.645949:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b9e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645955:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6b9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645970:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645977:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645983:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.645988:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734095.645996:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.646004:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.646012:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:0.0:1787734095.646015:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734095.646018:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.646024:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6ba5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734095.646121:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+24:14488:x1874574690080896:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 592us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.646129:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:3.0:1787734095.652871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734095.653086:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690081152 00000100:00100000:2.0:1787734095.653095:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690081152 00000100:00100000:2.0:1787734095.653185:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1787734095.653195:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+24:14488:x1874574690081152:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787734095.653215:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734095.653233:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729ac00/0x45228d86de4d6bac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19921 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653597:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b400/0x45228d86de4d6bb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653614:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b400/0x45228d86de4d6bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653624:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b400/0x45228d86de4d6bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787734095.653637:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787734095.653730:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b400/0x45228d86de4d6bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653749:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b400/0x45228d86de4d6bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653756:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b400/0x45228d86de4d6bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653762:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729b400 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787734095.653766:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b400/0x45228d86de4d6bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653773:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b400/0x45228d86de4d6bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653785:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:2.0:1787734095.653788:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787734095.653792:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b400/0x45228d86de4d6bb3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653798:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b400/0x45228d86de4d6bb3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653840:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729ac00/0x45228d86de4d6bac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19921 expref: 26 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653850:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff891ee0fd5700) 00010000:00010000:2.0:1787734095.653852:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787734095.653855:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729ac00/0x45228d86de4d6bac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19921 expref: 26 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.653864:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891dc729ac00, rc 0) 00000100:00100000:2.0:1787734095.653985:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+25:14488:x1874574690081152:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 790us (1123us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787734095.653992:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:3.0:1787734095.657993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734095.658149:0:16672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690081280 00000100:00100000:1.0:1787734095.658190:0:16672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690081280 00000100:00100000:1.0:1787734095.658240:0:16672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1787734095.658252:0:16672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+25:14488:x1874574690081280:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787734095.658656:0:16672:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787734095.658769:0:16672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+25:14488:x1874574690081280:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 519us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734095.658794:0:16672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:3.0:1787734095.662654:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734095.662728:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690081536 00000100:00100000:2.0:1787734095.662738:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690081536 00000100:00100000:2.0:1787734095.662804:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:2.0:1787734095.662816:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+25:14488:x1874574690081536:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787734095.662834:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787734095.662858:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b200/0x45228d86de4d6bc1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19928 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787734095.663817:0:14452:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1787734095.663825:0:14452:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1787734095.663880:0:14452:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787734095.664737:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729ac00/0x45228d86de4d6bc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.664756:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729ac00/0x45228d86de4d6bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.664767:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729ac00/0x45228d86de4d6bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.664835:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729b200/0x45228d86de4d6bc1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19928 expref: 28 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.664854:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729ac00/0x45228d86de4d6bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19928 expref: 27 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.664877:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ee0fd5d00) 00010000:00010000:2.0:1787734095.664880:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787734095.664884:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891dc729ac00, rc 0) 00000100:00100000:2.0:1787734095.665498:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+27:14488:x1874574690081536:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2673us (2842us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787734095.665509:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:3.0:1787734095.669214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.669515:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690081792 00000100:00100000:0.0:1787734095.669524:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690081792 00000100:00100000:0.0:1787734095.669580:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1787734095.669590:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+27:14488:x1874574690081792:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787734095.669646:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787734095.669675:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891dc729ac00/0x45228d86de4d6bc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19928 expref: 27 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669694:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ee0fd5d00) 00010000:00010000:0.0:1787734095.669705:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787734095.669727:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6bd6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669758:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669768:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669783:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6bdd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5b67440b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669789:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6bdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b67440b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669795:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6bdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b67440b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669867:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669874:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6bd6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669880:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6bd6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669886:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734095.669890:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6bd6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669896:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6bd6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669904:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff891ec6634f00) 00010000:00010000:0.0:1787734095.669912:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734095.669916:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6bd6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669922:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658600/0x45228d86de4d6bd6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669933:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6bdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b67440b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669939:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6bdd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b67440b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669945:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6bdd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b67440b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669950:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6658c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:0.0:1787734095.669952:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6bdd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b67440b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669958:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6bdd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b67440b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669965:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5b67440b (ffff891ec6771100) 00010000:00010000:0.0:1787734095.669967:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787734095.669969:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6bdd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5b67440b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.669974:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658c00/0x45228d86de4d6bdd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5b67440b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734095.670056:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+26:14488:x1874574690081792:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 467us (851us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787734095.670071:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:3.0:1787734095.673259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.673449:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690081920 00000100:00100000:0.0:1787734095.673459:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690081920 00000100:00100000:0.0:1787734095.673528:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1787734095.673539:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+26:14488:x1874574690081920:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787734095.673560:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734095.673585:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6be4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1992f expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.673625:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cb400/0x45228d86de4d6beb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.673639:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cb400/0x45228d86de4d6beb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.673650:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cb400/0x45228d86de4d6beb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.673749:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659200/0x45228d86de4d6be4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1992f expref: 28 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.673767:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cb400/0x45228d86de4d6beb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1992f expref: 27 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.673776:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ec6771a00) 00010000:00010000:0.0:1787734095.673779:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787734095.673783:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cb400, rc 0) 00000100:00100000:0.0:1787734095.673837:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+27:14488:x1874574690081920:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 299us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.673851:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:3.0:1787734095.676614:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.677124:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690082176 00000100:00100000:0.0:1787734095.677144:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690082176 00000100:00100000:0.0:1787734095.677215:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:0.0:1787734095.677224:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+27:14488:x1874574690082176:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787734095.677316:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.677333:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.677345:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787734095.677746:0:14453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1787734095.677757:0:14453:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413666600297ns, next at 414666598107ns, rc = 0 00000004:00010000:0.0:1787734095.677839:0:14453:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa7627e7 reply state 0000000038b402d9 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734095.677849:0:14453:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787734095.677943:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+29:14488:x1874574690082176:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 719us (1337us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787734095.677951:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:1.0:1787734095.681251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:2.0:1787734095.681365:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.681377:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.681384:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.681390:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13ca600 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:2.0:1787734095.681394:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.681401:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.681418:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ec6771a00) 00010000:00010000:2.0:1787734095.681421:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787734095.681426:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.681432:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13ca600/0x45228d86de4d6bf2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734095.681698:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690082304 00000100:00100000:0.0:1787734095.681708:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690082304 00000100:00100000:0.0:1787734095.681764:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:0.0:1787734095.681775:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+28:14488:x1874574690082304:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787734095.681798:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734095.681821:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbc00/0x45228d86de4d6bf9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19936 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.681882:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbc00/0x45228d86de4d6bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19936 expref: 29 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.681895:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbc00/0x45228d86de4d6bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19936 expref: 29 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.681924:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ec6771a00) 00010000:00010000:0.0:1787734095.681927:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787734095.681930:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cbc00, rc 0) 00000100:00100000:0.0:1787734095.681991:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+29:14488:x1874574690082304:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 217us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.681999:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:3.0:1787734095.685260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734095.685440:0:15137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690082432 00000100:00100000:2.0:1787734095.685451:0:15137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690082432 00000100:00100000:2.0:1787734095.685542:0:15137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1787734095.685554:0:15137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f018fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:2355:x1874574690082432:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787734095.685926:0:15137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f018fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:2355:x1874574690082432:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 373us (674us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787734095.685934:0:15137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00080000:1.0:1787734095.686281:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787734095.689085:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734095.689258:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690082688 00000100:00100000:2.0:1787734095.689268:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690082688 00000100:00100000:2.0:1787734095.689336:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1787734095.689346:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+29:14488:x1874574690082688:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787734095.689587:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+30:14488:x1874574690082688:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 241us (509us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787734095.689595:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1787734095.692336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.692532:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690082944 00000100:00100000:3.0:1787734095.692542:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690082944 00000100:00100000:3.0:1787734095.692602:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:3.0:1787734095.692612:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+30:14488:x1874574690082944:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787734095.692721:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+30:14488:x1874574690082944:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 110us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.692745:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:3.0:1787734095.694947:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.695037:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690083072 00000100:00100000:0.0:1787734095.695045:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690083072 00000100:00100000:0.0:1787734095.695094:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:0.0:1787734095.695104:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ef5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+30:14488:x1874574690083072:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787734095.695129:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787734095.695193:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cba00/0x45228d86de4d6c00 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df1993d expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.695276:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cac00/0x45228d86de4d6c07 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.695445:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cac00/0x45228d86de4d6c07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.695464:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cac00/0x45228d86de4d6c07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787734095.695897:0:14451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787734095.695974:0:14451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cac00/0x45228d86de4d6c07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.696003:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cba00/0x45228d86de4d6c00 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1993d expref: 32 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.696021:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cac00/0x45228d86de4d6c07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1993d expref: 31 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.696029:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ec6771a00) 00010000:00010000:1.0:1787734095.696032:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787734095.696035:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec13cac00, rc 0) 00000100:00100000:1.0:1787734095.696273:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ef5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+31:14488:x1874574690083072:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1171us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734095.696293:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:2.0:1787734095.699574:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.699665:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690083200 00000100:00100000:3.0:1787734095.699675:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690083200 00000100:00100000:3.0:1787734095.699760:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1787734095.699771:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+6:2354:x1874574690083200:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787734095.699789:0:15138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787734095.699811:0:15138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4ea1eae/0x45228d86de4d6c0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16ea362df19944 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787734095.699839:0:15138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ea850, blocks: 0x1 00010000:00010000:3.0:1787734095.699858:0:15138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=413s v=(0 0) 00010000:00010000:3.0:1787734095.699863:0:15138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787734095.699873:0:15138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ea1eae/0x45228d86de4d6c0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19944 expref: 7 pid: 15138 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.699891:0:15138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a4ea1eae/0x45228d86de4d6c0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19944 expref: 7 pid: 15138 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.699905:0:15138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891ec0031400, rc 0) 00000100:00100000:3.0:1787734095.699972:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:2354:x1874574690083200:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 203us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.699979:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:0.0:1787734095.702770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.702844:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690083456 00000100:00100000:3.0:1787734095.702853:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690083456 00000100:00100000:3.0:1787734095.702918:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:3.0:1787734095.702937:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+31:14488:x1874574690083456:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787734095.703045:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+31:14488:x1874574690083456:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 109us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.703053:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:0.0:1787734095.705704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734095.705796:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690083584 00000100:00100000:2.0:1787734095.705805:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690083584 00000100:00100000:2.0:1787734095.705904:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1787734095.705916:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+31:14488:x1874574690083584:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787734095.736401:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1787734095.736414:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787734095.736445:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:2.0:1787734095.736457:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1787734095.736462:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1787734095.736478:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1787734095.736689:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705790464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787734095.736756:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787734095.737026:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+14:14488:x1874574690083584:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 31109us (31327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.737036:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1787734095.739531:0:15137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705790464 00000100:00100000:3.0:1787734095.739544:0:15137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705790464 00000100:00100000:3.0:1787734095.739619:0:15137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787734095.739629:0:15137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874574705790464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787734095.739804:0:15137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787734095.739808:0:15137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787734095.739810:0:15137:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787734095.739812:0:15137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787734096 -> 1787734096 00002000:00010000:3.0:1787734095.739815:0:15137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:1.0:1787734095.739928:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787734095.740145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734095.740320:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690083712 00000100:00100000:1.0:1787734095.740325:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690083712 00000100:00100000:1.0:1787734095.740382:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1787734095.740389:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efec75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:2355:x1874574690083712:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787734095.740452:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efec75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:2355:x1874574690083712:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 63us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734095.740460:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:3.0:1787734095.741779:0:15137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874574705790464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2146us (5017us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787734095.741790:0:15137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1787734095.741878:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff891dc7b2c700/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787734095.741885:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874574705790464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787734095.743618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.743812:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690083968 00000100:00100000:3.0:1787734095.743820:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690083968 00000100:00100000:3.0:1787734095.743871:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:3.0:1787734095.743881:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+14:14488:x1874574690083968:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787734095.743943:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734095.743968:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cac00/0x45228d86de4d6c07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1993d expref: 14 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.743987:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ec6771a00) 00010000:00010000:3.0:1787734095.744004:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787734095.744033:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.744047:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.744056:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787734095.744288:0:14453:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000927746d8 reply state 00000000195ce548 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.744303:0:14453:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787734095.744396:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+15:14488:x1874574690083968:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 516us (785us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787734095.744404:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00010000:00010000:3.0:1787734095.746322:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.746336:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.746345:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.746350:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec0030a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734095.746355:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.746363:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.746393:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ec6771a00) 00010000:00010000:3.0:1787734095.746396:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787734095.746400:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.746406:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec0030a00/0x45228d86de4d6c15 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734095.747856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734095.748053:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690084096 00000100:00100000:2.0:1787734095.748062:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690084096 00000100:00100000:2.0:1787734095.748109:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1787734095.748126:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+7:2354:x1874574690084096:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787734095.748843:0:15990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787734095.748847:0:15990:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787734095 00002000:00010000:2.0:1787734095.748850:0:15990:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787734095 00002000:00010000:2.0:1787734095.748853:0:15990:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787734096 -> 1787734095 00002000:00010000:2.0:1787734095.748855:0:15990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787734095.748963:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+8:2354:x1874574690084096:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 837us (1112us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787734095.748971:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787734095.750869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.750989:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690084224 00000100:00100000:3.0:1787734095.750997:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690084224 00000100:00100000:3.0:1787734095.751052:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1787734095.751060:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efef6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+8:2354:x1874574690084224:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787734095.751097:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d6c1c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.751125:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787734095.751131:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787734095.751144:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d6c1c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.751177:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d6c1c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.751199:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d6c1c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.751205:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d6c1c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.751222:0:15136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d6c1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.751227:0:15136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734095.751230:0:15136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d6c1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.751235:0:15136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d6c1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.751246:0:15136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d6c1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.751251:0:15136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb4b28a7/0x45228d86de4d6c1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.751314:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efef6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+8:2354:x1874574690084224:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 255us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.751319:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:1.0:1787734095.752976:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.753063:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690084480 00000100:00100000:3.0:1787734095.753069:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690084480 00000100:00100000:3.0:1787734095.753227:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:3.0:1787734095.753234:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+14:14488:x1874574690084480:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787734095.753292:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6c23 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.753313:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6c23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.753321:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6c23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.753548:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.753564:0:14451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbc00/0x45228d86de4d6bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19936 expref: 15 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.753572:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.753603:0:14451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbc00/0x45228d86de4d6bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19936 expref: 15 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.753614:0:14451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbc00/0x45228d86de4d6bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19936 expref: 15 pid: 14451 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.753624:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1874574705790592:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787734095.753689:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5a44780 going to sleep for 11 seconds 00000100:00100000:3.0:1787734095.755435:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1874574705790592:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787734095.755459:0:14451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734095.760069:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.760182:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690084608 00000100:00100000:3.0:1787734095.760204:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690084608 00010000:00010000:3.0:1787734095.760245:0:14436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbc00/0x45228d86de4d6bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19936 expref: 16 pid: 14451 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.760292:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:3.0:1787734095.760304:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+16:2354:x1874574690084608:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787734095.760323:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787734095.760331:0:14436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbc00/0x45228d86de4d6bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19936 expref: 16 pid: 14451 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.760346:0:14436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbc00/0x45228d86de4d6bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19936 expref: 16 pid: 14451 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.760368:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec13cbc00/0x45228d86de4d6bf9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19936 expref: 16 pid: 14451 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.760384:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ec6771a00) 00010000:00010000:3.0:1787734095.760390:0:14436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.760400:0:14436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.760407:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.760441:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787734095.760508:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+15:2354:x1874574690084608:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 207us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.760525:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00010000:00010000:1.0:1787734095.760650:0:14451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.760658:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787734095.760835:0:14451:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787734095.760980:0:14451:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787734095.761028:0:14451:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787734095.761106:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14451:1874574705790720:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787734095.761530:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734095.761562:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ed0b0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787734095.761952:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705790720 00000100:00100000:0.0:1787734095.761960:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705790720 00000100:00100000:0.0:1787734095.762006:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787734095.762015:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14451:x1874574705790720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787734095.762095:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14451:x1874574705790720:12345-0@lo:1000:mdt00_000.0 Request processed in 81us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.762102:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787734095.762328:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14451:1874574705790720:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787734095.762957:0:14451:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1787734095.763023:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ef5d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14451:1874574705790848:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787734095.763064:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734095.763102:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5a44540 going to sleep for 11 seconds 00000100:00100000:0.0:1787734095.763335:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705790848 00000100:00100000:0.0:1787734095.763341:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705790848 00000100:00100000:0.0:1787734095.763368:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787734095.763375:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14451:x1874574705790848:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787734095.763540:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14451:x1874574705790848:12345-0@lo:1000:mdt00_000.0 Request processed in 163us (474us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787734095.763547:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787734095.763582:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ef5d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14451:1874574705790848:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787734095.763613:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763623:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763631:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763638:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1a00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734095.763643:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763649:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763664:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ec6771a00) 00010000:00010000:3.0:1787734095.763667:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787734095.763672:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763679:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1a00/0x45228d86de4d6c2a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763715:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763723:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763729:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763734:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec6659c00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734095.763737:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763743:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763751:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787734095.763754:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787734095.763760:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b90 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1991a expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763771:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b90 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1991a expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763780:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1991a expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.763827:0:14451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6658000/0x45228d86de4d6b90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df1991a expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.763848:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1874574705790976:192.168.201.34@tcp:105: 00000100:00100000:3.0:1787734095.763955:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5a44540 going to sleep for 11 seconds 00000100:00100000:3.0:1787734095.766809:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1874574705790976:192.168.201.34@tcp:105: 00010000:00010000:3.0:1787734095.766839:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766849:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec6659c00/0x45228d86de4d6b89 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766885:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6c31 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766899:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766909:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766919:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766925:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6c31 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766931:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6c31 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766935:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c0800 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734095.766939:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6c31 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766960:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6c31 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766972:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787734095.766975:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787734095.766979:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6c31 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766984:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c0800/0x45228d86de4d6c31 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.766995:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6c23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.767001:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6c23 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.767006:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6c23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.767010:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1e00 already unused, calling callback (ffffffffc1f3a4f0) 00010000:00010000:3.0:1787734095.767013:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6c23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.767019:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6c23 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.767025:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff891ec6771e00) 00010000:00010000:3.0:1787734095.767028:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787734095.767030:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6c23 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.767045:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891f020c1e00/0x45228d86de4d6c23 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.767317:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+18:14488:x1874574690084480:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 14080us (14345us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787734095.767328:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000020:00080000:3.0:1787734095.767335:0:14451:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787734095.767565:0:14485:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787734095.767570:0:14485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787734095.767597:0:14485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787734095.767603:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787734095.769779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734095.770243:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690084736 00000100:00100000:2.0:1787734095.770253:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690084736 00000100:00100000:2.0:1787734095.770311:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1787734095.770320:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ed0b70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+18:14486:x1874574690084736:12345-192.168.201.34@tcp:49:dd.0 00000100:00100000:2.0:1787734095.770603:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ed0b70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+18:14486:x1874574690084736:12345-192.168.201.34@tcp:49:dd.0 Request processed in 284us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787734095.770610:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1787734095.771852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787734095.775894:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690084992 00000100:00100000:1.0:1787734095.775910:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690084992 00000100:00100000:1.0:1787734095.775979:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1787734095.775990:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe59f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+18:14488:x1874574690084992:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787734095.776636:0:14455:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787734095.778569:0:14455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1787734095.778641:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.778794:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.778809:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.778817:0:14455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.778823:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.778829:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734095.778905:0:14455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787734095.779004:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe59f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+20:14488:x1874574690084992:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 3012us (7155us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787734095.779013:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000020:00080000:1.0:1787734095.779018:0:14455:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787734095.781281:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787734095.781296:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.781320:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc600 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787734095.781393:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.781403:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.781421:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff891ec6771a00) 00010000:00010000:2.0:1787734095.781424:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787734095.781429:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.781436:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891ec60cc600/0x45228d86de4d6c38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.781454:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734095.781456:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787734095.781458:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787734095.895610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.899723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.899857:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690085120 00000100:00100000:3.0:1787734095.899869:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690085120 00000100:00100000:3.0:1787734095.899937:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690085248 00000100:00100000:3.0:1787734095.899941:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690085248 00000100:00100000:3.0:1787734095.899962:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1787734095.899972:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+9:2356:x1874574690085120:12345-192.168.201.34@tcp:4:dd.0 00010000:00010000:3.0:1787734095.900007:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.900041:0:15142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4ea1eae/0x45228d86de4d6c0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xa16ea362df19944 expref: 9 pid: 15138 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.900049:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787734095.900053:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787734095.900056:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.900089:0:15142:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4ea1eae/0x45228d86de4d6c0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19944 expref: 9 pid: 15138 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.900130:0:15142:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4ea1eae/0x45228d86de4d6c0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19944 expref: 9 pid: 15138 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.900146:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891ec60c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:15142:1874574705791104:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787734095.900257:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff891ec5a44540 going to sleep for 11 seconds 00000100:00100000:0.0:1787734095.901629:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787734095.901719:0:15143:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787734095.901729:0:15143:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787734095.902011:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690085376 00000100:00100000:0.0:1787734095.902018:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690085376 00000100:00100000:2.0:1787734095.902611:0:16673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:2.0:1787734095.902623:0:16673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+10:2357:x1874574690085248:12345-192.168.201.34@tcp:4:dd.0 00010000:00010000:2.0:1787734095.902655:0:16673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.902669:0:16673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734095.902672:0:16673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734095.902675:0:16673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.902690:0:16673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734095.907224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.907255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.907285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.907299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.907324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.907343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787734095.907377:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690086144 00000100:00100000:0.0:1787734095.907385:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690086144 00010000:00010000:0.0:1787734095.907425:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ea1eae/0x45228d86de4d6c0e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19944 expref: 11 pid: 15138 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734095.907462:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787734095.907472:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+11:2354:x1874574690086144:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787734095.907499:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787734095.907523:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4ea1eae/0x45228d86de4d6c0e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19944 expref: 11 pid: 15138 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.907538:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4ea1eae/0x45228d86de4d6c0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19944 expref: 11 pid: 15138 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.907563:0:14437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787734095.907568:0:14437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787734095.907574:0:14437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.907602:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.907610:0:14437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787734095.907613:0:14437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787734095.907616:0:14437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.907622:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734095.907644:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787734095.907692:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+11:2354:x1874574690086144:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 220us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787734095.907699:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1787734095.907864:0:15143:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787734095.907882:0:15143:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00010000:00010000:2.0:1787734095.907905:0:16673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.907922:0:16673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734095.909816:0:15141:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787734095.909836:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690085504 00000100:00100000:1.0:1787734095.909844:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690085504 00000100:00100000:1.0:1787734095.909899:0:15141:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787734095.909904:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690085632 00000100:00100000:1.0:1787734095.909908:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690085632 00000100:00100000:1.0:1787734095.909931:0:15141:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787734095.909935:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690085760 00000100:00100000:1.0:1787734095.909938:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690085760 00000100:00100000:1.0:1787734095.909948:0:15141:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787734095.909961:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690085888 00000100:00100000:1.0:1787734095.909964:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690085888 00000100:00100000:1.0:1787734095.909979:0:15141:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787734095.909983:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690086016 00000100:00100000:1.0:1787734095.909985:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690086016 00000100:00100000:2.0:1787734095.911290:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1787734095.911372:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+16:2357:x1874574690085376:12345-192.168.201.34@tcp:4:dd.0 00010000:00010000:2.0:1787734095.911410:0:16674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a993a51/0x45228d86de4d6c4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.911428:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734095.911433:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734095.911441:0:16674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a993a51/0x45228d86de4d6c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734095.911455:0:16674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a993a51/0x45228d86de4d6c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.913433:0:15142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4ea1eae/0x45228d86de4d6c0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xa16ea362df19944 expref: 16 pid: 15138 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.913457:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891ec60c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:15142:1874574705791104:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787734095.913490:0:15142:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.913502:0:15142:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734095.913510:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734095.988096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.988124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.988177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.988202:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690086272 00000100:00100000:3.0:1787734095.988212:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690086272 00000100:00100000:3.0:1787734095.988259:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:3.0:1787734095.988277:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:2357:x1874574690086272:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787734095.988350:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dee5c0f-8c74-494c-994c-130f4d2be35b+13:2357:x1874574690086272:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 75us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.988356:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:3.0:1787734095.988403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.988425:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690086528 00000100:00100000:3.0:1787734095.988429:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690086528 00000100:00100000:3.0:1787734095.988458:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1787734095.988464:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2357:x1874574690086528:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787734095.988506:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cc34a2c-4c56-448f-b60c-fc108953c500+6:2357:x1874574690086528:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 43us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.988513:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1787734095.988589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787734095.988606:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690086400 00000100:00100000:3.0:1787734095.988609:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690086400 00000100:00100000:3.0:1787734095.988638:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690086656 00000100:00100000:3.0:1787734095.988640:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690086656 00000100:00100000:3.0:1787734095.988650:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574690086784 00000100:00100000:3.0:1787734095.988651:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574690086784 00000100:00100000:3.0:1787734095.988663:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1787734095.988668:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:2357:x1874574690086400:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787734095.988688:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:2357:x1874574690086400:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 20us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.988694:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1787734095.988702:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787734095.988707:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891ec60c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+5:2357:x1874574690086656:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787734095.988733:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891ec60c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+5:2357:x1874574690086656:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.988738:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787734095.988747:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1787734095.988751:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+5:2357:x1874574690086784:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787734095.988766:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cc34a2c-4c56-448f-b60c-fc108953c500+5:2357:x1874574690086784:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 15us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734095.988769:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00080000:1.0:1787734095.990328:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787734095.990336:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787734096.009078:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1787734096.009099:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:3.0:1787734096.009461:0:16674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1787734096.009467:0:16674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787734095 -> 1787734096 00002000:00010000:3.0:1787734096.009469:0:16674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787734095 -> 1787734096 00002000:00010000:3.0:1787734096.009472:0:16674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1787734096.009495:0:16674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a993a51/0x45228d86de4d6c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734096.009509:0:16674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a993a51/0x45228d86de4d6c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734096.009518:0:16674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a993a51/0x45228d86de4d6c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734096.009525:0:16674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729b800 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:3.0:1787734096.009530:0:16674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a993a51/0x45228d86de4d6c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734096.009560:0:16674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a993a51/0x45228d86de4d6c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734096.009581:0:16674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a993a51/0x45228d86de4d6c4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734096.009590:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a993a51/0x45228d86de4d6c4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787734096.009688:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+16:2357:x1874574690085376:12345-192.168.201.34@tcp:4:dd.0 Request processed in 98316us (108060us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787734096.009698:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1787734096.009733:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:3.0:1787734096.009744:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+15:2357:x1874574690085504:12345-192.168.201.34@tcp:4:dd.0 00010000:00010000:3.0:1787734096.009779:0:16674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac7d97e/0x45228d86de4d6c54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734096.009791:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787734096.009795:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787734096.009802:0:16674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac7d97e/0x45228d86de4d6c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734096.009813:0:16674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bac7d97e/0x45228d86de4d6c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.010590:0:16673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.010603:0:16673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.010611:0:16673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.010618:0:16673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729b600 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734096.010622:0:16673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.010640:0:16673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.010653:0:16673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.010660:0:16673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac911dc3/0x45228d86de4d6c46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734096.010706:0:16673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+15:2357:x1874574690085248:12345-192.168.201.34@tcp:4:dd.0 Request processed in 108084us (110994us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787734096.010720:0:16673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:0.0:1787734096.010739:0:16673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1787734096.010747:0:16673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+14:2357:x1874574690085632:12345-192.168.201.34@tcp:4:dd.0 00010000:00010000:0.0:1787734096.010766:0:16673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d6c5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.010776:0:16673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787734096.010780:0:16673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787734096.010784:0:16673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d6c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.010794:0:16673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d6c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787734096.055846:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1787734096.059219:0:15142:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:1.0:1787734096.059233:0:15142:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1787734096.059250:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.059263:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.059273:0:15142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.059280:0:15142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1e00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734096.059285:0:15142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.059358:0:15142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.059461:0:15142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.059500:0:15142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6d7008d/0x45228d86de4d6c3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734096.059646:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+16:2356:x1874574690085120:12345-192.168.201.34@tcp:4:dd.0 Request processed in 159670us (164041us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787734096.059657:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1787734096.059691:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:1.0:1787734096.059703:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+15:2356:x1874574690085760:12345-192.168.201.34@tcp:4:dd.0 00010000:00010000:1.0:1787734096.059733:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016c9ba1b/0x45228d86de4d6c62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.059746:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787734096.059750:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787734096.059758:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016c9ba1b/0x45228d86de4d6c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.059769:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016c9ba1b/0x45228d86de4d6c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787734096.114791:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:2.0:1787734096.120562:0:16674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1787734096.120574:0:16674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:2.0:1787734096.120593:0:16674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac7d97e/0x45228d86de4d6c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.120610:0:16674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bac7d97e/0x45228d86de4d6c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.120621:0:16674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bac7d97e/0x45228d86de4d6c54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.120630:0:16674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891f020c1a00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787734096.120636:0:16674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac7d97e/0x45228d86de4d6c54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.120645:0:16674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac7d97e/0x45228d86de4d6c54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.120824:0:16674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bac7d97e/0x45228d86de4d6c54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.120834:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bac7d97e/0x45228d86de4d6c54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.121239:0:16673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d6c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.121250:0:16673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d6c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.121281:0:16673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d6c5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734096.121400:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+13:2357:x1874574690085504:12345-192.168.201.34@tcp:4:dd.0 Request processed in 111653us (214180us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787734096.121412:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:2.0:1787734096.121460:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1787734096.121473:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+12:2356:x1874574690085888:12345-192.168.201.34@tcp:4:dd.0 00010000:00010000:2.0:1787734096.121517:0:16674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e17338c/0x45228d86de4d6c69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.121529:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734096.121533:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787734096.121540:0:16674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e17338c/0x45228d86de4d6c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.121551:0:16674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e17338c/0x45228d86de4d6c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.121878:0:16673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec13cbe00 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:1.0:1787734096.121883:0:16673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d6c5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.121892:0:16673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d6c5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.121905:0:16673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d6c5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.121913:0:16673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081b118e7/0x45228d86de4d6c5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787734096.121966:0:16673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+12:2357:x1874574690085632:12345-192.168.201.34@tcp:4:dd.0 Request processed in 111219us (214710us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787734096.121973:0:16673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1787734096.121990:0:16673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1787734096.121998:0:16673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe94b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+11:2356:x1874574690086016:12345-192.168.201.34@tcp:4:dd.0 00010000:00010000:1.0:1787734096.122015:0:16673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b55f44e/0x45228d86de4d6c70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.122023:0:16673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787734096.122032:0:16673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787734096.122037:0:16673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b55f44e/0x45228d86de4d6c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787734096.122047:0:16673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b55f44e/0x45228d86de4d6c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787734096.135494:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787734096.163318:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1787734096.163898:0:15142:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:0.0:1787734096.163972:0:15142:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1787734096.163988:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016c9ba1b/0x45228d86de4d6c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.164002:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016c9ba1b/0x45228d86de4d6c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.164011:0:15142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016c9ba1b/0x45228d86de4d6c62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.164030:0:15142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc600 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734096.164035:0:15142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016c9ba1b/0x45228d86de4d6c62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.164044:0:15142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016c9ba1b/0x45228d86de4d6c62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.164064:0:15142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016c9ba1b/0x45228d86de4d6c62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.164071:0:15142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016c9ba1b/0x45228d86de4d6c62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734096.164247:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+13:2356:x1874574690085760:12345-192.168.201.34@tcp:4:dd.0 Request processed in 104542us (256955us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787734096.164266:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00002000:00010000:2.0:1787734096.192919:0:16674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1787734096.192941:0:16674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e17338c/0x45228d86de4d6c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.192954:0:16674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e17338c/0x45228d86de4d6c69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.192963:0:16674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e17338c/0x45228d86de4d6c69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.192970:0:16674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891dc729a200 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:2.0:1787734096.192975:0:16674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e17338c/0x45228d86de4d6c69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.193004:0:16674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e17338c/0x45228d86de4d6c69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.193025:0:16674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e17338c/0x45228d86de4d6c69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787734096.193033:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e17338c/0x45228d86de4d6c69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787734096.193123:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+11:2356:x1874574690085888:12345-192.168.201.34@tcp:4:dd.0 Request processed in 71649us (285816us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787734096.193144:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000001:00080000:2.0:1787734096.193205:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:2.0:1787734096.193216:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1787734096.194086:0:16673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b55f44e/0x45228d86de4d6c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.194100:0:16673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b55f44e/0x45228d86de4d6c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.194108:0:16673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b55f44e/0x45228d86de4d6c70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.194115:0:16673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891ec60cc400 already unused, calling callback (ffffffffc14fc230) 00010000:00010000:0.0:1787734096.194119:0:16673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b55f44e/0x45228d86de4d6c70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.194137:0:16673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b55f44e/0x45228d86de4d6c70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.194149:0:16673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b55f44e/0x45228d86de4d6c70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787734096.194312:0:16673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b55f44e/0x45228d86de4d6c70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787734096.194395:0:16673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe94b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9113f1b-3fbc-4ea7-9dd4-18551f3d1fcf+5:2356:x1874574690086016:12345-192.168.201.34@tcp:4:dd.0 Request processed in 72394us (287067us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787734096.194405:0:16673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00010000:00010000:2.0:1787734097.147000:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787734097.552032:0:16713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787734098.170339:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787734098.746499:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787734098.746523:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705791232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787734098.746593:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734098.746662:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705791232 00000100:00100000:1.0:1787734098.746669:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705791232 00000100:00100000:1.0:1787734098.746739:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787734098.746749:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705791232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787734098.746783:0:15140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1787734098.746831:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874574705791232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734098.746838:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787734098.746870:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787734098.746899:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787734098.746904:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff891dc7b2c700, transno 8589934595 00000004:00080000:1.0:1787734098.746915:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1787734098.746946:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874574705791232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787734098.747885:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787734098.747899:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891efe948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705791360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787734098.747944:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734098.748231:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705791744:0@lo:400:kworker.0 00000100:00100000:1.0:1787734098.748261:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734098.748286:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787734098.748292:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705791872:0@lo:400:kworker.0 00000100:00100000:1.0:1787734098.748327:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787734098.748352:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705791360 00000100:00100000:1.0:1787734098.748359:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705791360 00000100:00100000:1.0:1787734098.748410:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787734098.748418:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891efe948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705791360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787734098.748454:0:15140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787734098.748496:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891efe948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874574705791360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734098.748504:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787734098.748525:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787734098.748551:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891efe948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874574705791360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787734098.748620:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3310:1874574705791488:0@lo:400:kworker.0 00000100:00100000:3.0:1787734098.748654:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734098.748686:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787734098.748691:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff891dc7b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705791616:0@lo:400:kworker.0 00000100:00100000:3.0:1787734098.748712:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787734098.748737:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705791744 00000100:00100000:3.0:1787734098.748741:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705791744 00000100:00100000:3.0:1787734098.748769:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705791872 00000100:00100000:3.0:1787734098.748772:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705791872 00000100:00100000:3.0:1787734098.748784:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705791616 00000100:00100000:3.0:1787734098.748786:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705791616 00000100:00100000:3.0:1787734098.748799:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787734098.748804:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705791744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787734098.748837:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874574705791744:12345-0@lo:400:kworker.0 Request processed in 33us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734098.748844:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787734098.748856:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787734098.748874:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891dc7b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705791872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787734098.748900:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891dc7b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874574705791872:12345-0@lo:400:kworker.0 Request processed in 27us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734098.748905:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787734098.748916:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787734098.748922:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891eefd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705791616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787734098.748972:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891eefd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874574705791616:12345-0@lo:400:kworker.0 Request processed in 50us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787734098.748979:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787734098.749010:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874574705791616:0@lo:400:kworker.0 00000100:00100000:1.0:1787734098.749763:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874574705791488 00000100:00100000:1.0:1787734098.749770:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874574705791488 00000100:00100000:1.0:1787734098.749811:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787734098.749819:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891f0183cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:3310:x1874574705791488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787734098.749887:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891f0183cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06+19:3310:x1874574705791488:12345-0@lo:400:kworker.0 Request processed in 68us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787734098.749894:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1787734098.749920:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787734098.749945:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874574705791872:0@lo:400:kworker.0 00000100:00100000:1.0:1787734098.749967:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874574705791744:0@lo:400:kworker.0 00000100:00100000:0.0:1787734098.750137:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff891dc7b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8bc5a29a-c0a9-4a8d-a0aa-316066d4be06:3310:1874574705791488:0@lo:400:kworker.0 Debug log: 28840 lines, 28840 kept, 0 dropped, 0 bad.